-- Logs begin at Wed 2022-06-22 18:45:34 UTC, end at Wed 2022-06-22 20:35:37 UTC. -- Jun 22 19:30:09.393225 dv-cinder-847216-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 19:30:09.402838 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 19:30:09 2022] *** Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: nodename: dv-cinder-847216-1-iscsi Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: machine: x86_64 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: clock source: unix Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: pcre jit disabled Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: detected number of CPU cores: 4 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: current working directory: / Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: detected binary path: /usr/bin/uwsgi-core Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: your processes number limit is 47680 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: your memory page size is 4096 bytes Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: detected max file descriptor number: 2048 Jun 22 19:30:09.404899 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: lock engine: pthread robust mutexes Jun 22 19:30:09.405878 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: thunder lock: enabled Jun 22 19:30:09.405878 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 19:30:09.405878 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 19:30:09.447881 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: Python main interpreter initialized at 0x556ee8f229c0 Jun 22 19:30:09.447881 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: python threads support enabled Jun 22 19:30:09.447881 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: your server socket listen backlog is limited to 100 connections Jun 22 19:30:09.447881 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: your mercy for graceful operations on workers is 90 seconds Jun 22 19:30:09.448316 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 19:30:09.448316 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: *** Operational MODE: preforking *** Jun 22 19:30:09.448548 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: *** uWSGI is running in multiple interpreter mode *** Jun 22 19:30:09.448548 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: spawned uWSGI master process (pid: 104122) Jun 22 19:30:09.448745 dv-cinder-847216-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 19:30:09.449771 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: spawned uWSGI worker 1 (pid: 104127, cores: 1) Jun 22 19:30:09.449771 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: spawned uWSGI worker 2 (pid: 104128, cores: 1) Jun 22 19:30:09.449771 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 19:30:10.109312 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 19:30:10.111335 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 19:30:11.242664 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:30:11.242664 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: from cryptography.utils import int_from_bytes Jun 22 19:30:11.243370 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:30:11.243370 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: from cryptography.utils import int_from_bytes Jun 22 19:30:11.243511 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:30:11.243511 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: from cryptography.utils import int_from_bytes Jun 22 19:30:11.243925 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:30:11.243925 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: from cryptography.utils import int_from_bytes Jun 22 19:30:13.689387 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 19:30:13.689999 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 19:30:13.690362 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 19:30:13.690454 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 19:30:13.690524 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 19:30:13.690596 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 19:30:13.690663 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 19:30:13.690773 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 19:30:13.690842 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 19:30:13.690915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 19:30:13.691108 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.691258 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.691400 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.691561 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.691760 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.691909 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692071 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692235 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692469 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692615 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692710 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.692845 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693168 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693354 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693472 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693679 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693830 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.693919 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694022 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694223 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694325 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694546 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-1-iscsi {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694638 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-1-iscsi {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694867 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.694983 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695172 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695272 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695481 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695574 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695797 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.695975 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696160 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696253 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696459 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696584 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696739 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.696894 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.697226 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.697396 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.697664 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.697834 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.697971 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698284 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698377 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698619 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698720 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.698931 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.699024 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.699237 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.699456 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.699652 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.699832 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700011 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700232 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700407 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700581 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700764 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.700951 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.701149 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-1-iscsi {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.701342 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-1-iscsi {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.701533 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.701731 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.701879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.702056 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.702270 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.702463 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.702617 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.702833 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703118 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703274 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703421 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703561 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703727 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.703859 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704021 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704176 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704450 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704579 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704741 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704866 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.704988 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705115 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705239 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705371 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705502 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705625 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705745 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705864 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705993 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.705993 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.706417 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.706540 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.706661 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.706781 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.706909 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707042 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707164 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707286 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707418 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707539 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707659 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707787 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.707908 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708267 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708456 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708603 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708780 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.708941 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709196 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709330 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709464 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709599 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709722 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709844 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.709965 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710203 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710387 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710673 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710803 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.710927 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711062 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711184 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711405 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711584 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711716 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711839 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.711979 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712133 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712337 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712672 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.712930 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713053 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713254 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713441 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713580 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713724 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.713954 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714140 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714281 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714407 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714512 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714629 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.714826 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715003 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715135 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715260 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715382 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715522 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715727 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.715902 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716034 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716209 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716449 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716588 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716716 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716838 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.716958 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717077 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717210 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717343 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717623 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.717931 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718055 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718191 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718314 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718435 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718555 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718675 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.718797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.719385 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.719622 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.719853 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.720055 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.720306 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.720504 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.720725 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.720942 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.721111 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.721291 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.721495 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.721696 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.721916 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722087 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722213 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722345 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722475 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722608 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722731 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.722860 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.723324 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.723445 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.723624 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.723824 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.723824 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.724240 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.724437 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.724636 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.724855 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.725063 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.725238 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.725450 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.725650 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.725851 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726043 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726190 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726327 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726468 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726679 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726817 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.726947 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.727114 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.727313 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.727525 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.727730 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.727930 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728155 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728155 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728435 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728559 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728559 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728796 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728916 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.728916 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729163 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729295 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729416 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729537 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729658 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729786 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.729907 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730027 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730147 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730266 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730466 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730590 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730710 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730842 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.730963 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731083 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731211 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731334 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731462 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731583 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731710 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731832 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.731970 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732140 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732265 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732387 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732520 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732651 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732782 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.732903 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733023 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733144 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733263 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733396 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733519 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733640 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733760 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733879 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.733999 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.734199 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.734375 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.734509 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.734637 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.734836 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:30:13.735012 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735158 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735285 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735486 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735663 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735807 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.735933 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.736119 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.736251 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.736471 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.736704 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737081 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737276 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737420 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737545 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737682 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.737812 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738028 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738215 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738350 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738484 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738616 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738741 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.738958 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739145 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739280 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739409 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739557 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739691 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.739891 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740080 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740290 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740433 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740558 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740687 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740812 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.740947 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741155 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741343 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741491 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741616 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741748 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.741883 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742087 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742275 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742409 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742533 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742667 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.742790 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743206 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743339 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743462 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743604 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743730 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.743951 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744156 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744284 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744409 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744556 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744680 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.744901 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745215 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745341 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745533 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745661 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745844 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.745969 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746157 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746298 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746471 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746597 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746784 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.746926 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747129 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747267 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747403 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747525 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747682 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747809 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.747994 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748167 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748343 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748523 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748647 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748768 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.748964 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749104 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749274 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749398 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749583 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749715 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.749891 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750017 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750240 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750371 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750538 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750672 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750839 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.750993 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751144 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751270 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751445 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751569 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751761 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.751888 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752056 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752242 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752403 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752558 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752765 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.752890 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753010 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753131 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753342 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753478 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753651 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753776 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.753960 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754085 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754270 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754416 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754608 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754746 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.754887 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755008 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755182 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755322 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755493 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755618 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755799 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.755923 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756146 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756293 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756451 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756588 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756761 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.756886 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757074 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757284 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757417 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757538 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757668 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757790 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.757968 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758095 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758279 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758404 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758594 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758723 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.758906 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759036 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759201 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759334 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759525 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759652 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759836 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.759971 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760165 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760315 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760499 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760634 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760823 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.760946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761126 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761250 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761434 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761567 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761747 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.761875 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762053 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762179 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762345 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762485 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762647 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762773 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.762948 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763073 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763249 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763382 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763549 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763673 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763851 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.763977 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764161 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764296 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764463 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764588 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764763 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.764899 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765064 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765185 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765366 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765500 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765669 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765830 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.765998 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766132 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766299 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766424 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766599 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766724 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.766899 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767027 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767236 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767440 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767565 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767700 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.767867 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768332 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768332 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768539 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768657 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768772 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768886 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.768997 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769104 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769207 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769621 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769763 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769871 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.769975 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770080 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770185 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770554 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770698 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770805 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.770916 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771021 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771124 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771229 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771341 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771693 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771819 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.771960 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772263 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772263 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772509 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772616 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772719 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772823 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.772926 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773090 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773204 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773405 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773517 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773725 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.773857 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774037 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774164 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774353 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774487 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774665 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774791 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.774972 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775106 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775280 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775405 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775584 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775716 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.775890 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776015 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776220 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776360 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776529 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776665 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776841 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.776972 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777149 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777272 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777503 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777663 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777763 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.777845 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778112 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778246 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778388 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778710 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.778835 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779012 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779137 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779325 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779462 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779645 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779768 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.779969 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780149 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780294 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780417 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780597 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780724 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.780913 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781037 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781239 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781410 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781566 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781702 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.781880 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782005 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782184 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782308 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782487 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782626 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782794 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.782917 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783095 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783222 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783416 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783542 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783731 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.783866 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784038 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784182 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784370 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784495 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784676 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784808 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.784981 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785107 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785283 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785402 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785593 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785728 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.785917 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786042 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786225 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786351 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786530 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786664 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786850 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.786982 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787157 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787283 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787460 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787673 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.787925 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788049 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788187 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788391 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788517 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788700 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.788827 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789004 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789132 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789322 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789448 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789643 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789775 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.789947 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790077 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790264 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790399 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790583 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790710 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.790892 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791027 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791202 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791329 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791511 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791637 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791820 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.791958 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792152 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792283 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792468 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792593 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792773 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.792910 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793084 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793209 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793389 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793513 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793702 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.793836 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794012 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794135 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794324 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794457 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794630 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794761 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.794938 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795075 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795243 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795368 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795548 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795819 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.795944 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.796173 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.796303 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.796493 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.796742 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.796923 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797098 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797274 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797401 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797596 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797813 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.797939 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798060 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798241 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798375 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798587 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798728 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.798905 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799032 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799219 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799344 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799533 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799670 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799842 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.799977 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800177 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800305 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800486 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800621 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800789 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.800923 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801092 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801217 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801395 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801522 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801700 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.801834 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802007 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802133 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802307 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802448 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802612 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.802914 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803048 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803220 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803347 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803529 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803654 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803832 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.803965 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804165 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804294 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804473 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804601 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.804903 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805082 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805282 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805414 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805534 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805655 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805785 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.805957 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806092 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806292 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806454 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806582 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806703 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.806926 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807096 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807254 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807355 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807561 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807666 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807888 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.807994 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808219 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808357 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808530 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808658 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808839 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.808967 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809151 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809276 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809463 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809588 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809770 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.809904 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810077 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810211 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810379 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810519 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810687 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810821 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.810992 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811124 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811295 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811419 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811601 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811727 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.811905 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.812039 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.812266 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.812538 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.812899 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.813208 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814326 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814461 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814585 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814722 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814853 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.814976 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815100 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815222 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815352 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815487 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815611 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815731 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815852 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.815985 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816136 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816276 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816402 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816513 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816635 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816756 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.816885 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817008 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817129 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817250 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817372 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817492 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817620 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817743 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.817863 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818070 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818194 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818316 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818448 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818570 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818690 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818810 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.818939 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819060 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819190 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819312 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819434 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819553 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819673 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819808 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.819972 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820126 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820318 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820458 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820623 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820764 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.820933 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821068 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821237 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821363 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821540 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821685 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821847 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.821973 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822153 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822279 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822455 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822592 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822756 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.822882 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823060 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823186 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823363 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823491 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823665 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823793 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.823971 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824128 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824303 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824430 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824607 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.824912 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825038 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825213 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825347 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825516 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825646 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825823 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.825948 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826169 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826295 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826476 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826609 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826787 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.826925 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827104 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827231 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827413 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827540 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827722 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.827860 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828032 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828187 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828385 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828512 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828700 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.828837 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829007 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829133 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829315 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829439 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829618 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829753 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.829920 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830046 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830231 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830355 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830537 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830671 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830845 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.830970 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831160 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831284 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831474 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831608 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831790 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.831915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832091 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832235 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832421 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832556 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832733 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.832866 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833040 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833176 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833348 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833475 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833656 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833782 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.833965 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834091 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834293 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834423 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834568 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834696 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.834877 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835016 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835183 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835310 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835486 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835613 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835791 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.835926 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836111 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836240 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836427 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836562 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.836875 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837045 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837169 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837347 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837473 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837656 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.837960 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838084 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838263 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838389 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838568 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838688 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.838880 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839006 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839188 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839315 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839597 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839723 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.839903 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840235 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840363 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840547 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840674 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840860 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.840995 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841173 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841307 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841478 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841605 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841804 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.841936 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842111 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842246 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842609 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842792 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.842917 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843094 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843232 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843397 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843523 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843704 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.843854 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844063 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844293 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844425 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844549 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844714 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.844848 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845019 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845152 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845325 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845459 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845629 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845755 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.845946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846079 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846249 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846374 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846572 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846707 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.846947 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.847079 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.847287 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.847412 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.847594 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.847727 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.848336 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.848564 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.848700 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.848814 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.848965 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849100 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849286 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849412 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849587 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849723 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.849896 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850050 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850206 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850334 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850527 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850654 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850840 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.850967 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851148 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851281 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851460 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851587 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851763 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.851889 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852079 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852234 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852407 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852546 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852725 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.852849 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853043 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853183 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853353 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853478 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853677 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.853814 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854055 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854190 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854377 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854504 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854702 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.854827 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855005 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855132 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855309 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855428 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855619 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855754 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.855924 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856058 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856254 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856378 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856551 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856676 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856854 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.856979 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857164 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857293 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857471 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857597 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857779 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.857908 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858084 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858211 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858389 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858521 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858696 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858821 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.858998 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859122 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859318 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859474 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859659 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859785 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.859980 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860134 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860317 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860464 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860624 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860749 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.860944 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861070 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861252 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861387 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861554 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861679 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.861872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.862178 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.862344 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.862472 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.862657 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.862783 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863000 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863134 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863306 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863433 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863627 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863753 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.863957 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864091 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864314 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864450 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864629 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864755 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.864960 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865097 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865286 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865419 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865603 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865732 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.865923 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866056 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866247 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866383 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866552 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866685 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866853 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.866987 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867162 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867286 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867462 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867594 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867766 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.867901 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868069 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868214 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868406 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868540 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868711 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.868849 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869015 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869141 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869315 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869446 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869633 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869762 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.869935 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870061 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870254 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870380 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870562 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870687 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870861 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.870986 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.871164 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.871289 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.871463 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.871588 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.871805 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872141 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872274 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872442 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872578 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872772 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.872897 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873089 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873214 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873414 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873541 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873725 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.873842 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874145 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874280 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874433 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874540 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874644 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874747 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.874964 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.875376 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.875493 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.875599 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.875704 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.875807 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876191 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876323 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876444 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876551 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876656 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876760 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.876901 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.877023 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.877218 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.877336 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.877538 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.877807 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878158 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878374 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878558 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878691 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.878890 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879002 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879206 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879327 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879521 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879649 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879832 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.879973 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880167 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880298 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880482 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880607 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880796 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.880935 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881107 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881233 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881417 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881551 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881726 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.881934 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882068 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882191 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882364 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882491 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882690 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.882852 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883011 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883136 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883329 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883457 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883644 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883771 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.883958 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884093 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884297 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884437 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884625 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884756 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.884942 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885068 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885251 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885384 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885548 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885674 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885860 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.885983 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886167 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886302 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886479 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886606 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886789 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.886915 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887097 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887224 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887408 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887541 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887720 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.887843 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888196 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888366 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888500 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888684 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.888810 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889012 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889137 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889313 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889445 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889631 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889770 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.889945 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.890079 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.890256 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.890460 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.890585 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.890824 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891116 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891250 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891433 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891560 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891768 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.891904 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892091 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892236 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892434 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892572 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892747 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.892885 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893055 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893179 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893362 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893495 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893673 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893798 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.893977 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894112 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894281 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894406 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894589 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894714 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.894893 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895019 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895195 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895320 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895515 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895647 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895816 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.895942 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.896154 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.896366 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.896506 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.896721 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.896983 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897117 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897331 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897466 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897646 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897771 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.897971 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898098 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898293 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898428 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898619 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898745 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.898927 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899060 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899251 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899390 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899606 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899741 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899863 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.899991 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900184 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900313 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900495 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900622 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900802 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.900929 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901106 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901235 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901418 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901552 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901730 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.901865 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902033 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902165 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902341 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902480 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902645 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902770 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.902951 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903078 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903261 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903388 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903565 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903708 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.903869 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904001 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904196 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904324 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904509 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904644 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904817 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.904943 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905132 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905258 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905440 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905575 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905750 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.905874 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906178 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906385 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906513 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906691 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906798 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.906998 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907088 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907304 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907408 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907613 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907739 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.907966 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908071 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908314 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908406 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908624 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908721 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.908927 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909017 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909239 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909328 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909550 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909654 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909878 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.909976 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.910187 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.910276 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.910497 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.910585 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.910839 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.911040 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.911157 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.911381 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.911692 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.911781 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912150 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912388 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912484 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912702 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.912790 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913014 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913110 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913326 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913415 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913631 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913725 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.913937 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914034 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914258 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914346 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914568 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914655 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.914976 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915188 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915276 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915497 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915583 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915804 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.915894 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916131 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916223 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916439 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916607 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916759 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.916898 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917037 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917173 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917339 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917501 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917639 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917775 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.917942 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918087 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918271 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918491 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918638 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918785 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.918922 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919060 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919196 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919341 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919479 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919622 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919791 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.919942 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920080 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920263 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920406 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920543 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.920862 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921029 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921174 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921340 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921484 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921655 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921799 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.921944 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.922164 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.922366 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.922517 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.922675 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.922820 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923024 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923168 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923349 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923501 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923648 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923799 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.923975 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924156 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924313 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924452 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924628 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924784 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.924950 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925093 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925262 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925405 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925583 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925734 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.925881 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926018 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926212 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926356 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926549 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926694 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926854 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.926997 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927142 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927279 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927454 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927598 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927767 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.927918 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928067 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928236 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928397 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928538 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928700 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928850 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.928995 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929142 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929280 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929425 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929586 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.929877 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930038 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930175 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930318 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930456 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930594 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930761 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.930914 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931060 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931197 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931355 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931499 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931637 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931783 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.931930 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932068 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932257 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932395 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932544 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932683 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932828 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.932965 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933101 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933237 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933411 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933562 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933699 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933852 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.933992 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934277 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934414 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934583 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934735 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.934882 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935023 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935232 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935366 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935560 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935694 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.935880 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936027 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936220 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936352 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936529 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936696 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936819 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.936974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937111 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937248 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937433 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937597 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937757 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.937904 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938080 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938222 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938393 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938535 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938706 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.938859 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939022 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939168 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939333 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939476 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939647 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939801 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.939961 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940142 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940286 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940423 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940600 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940759 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.940926 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941076 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941253 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941395 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941562 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941717 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.941882 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942032 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942198 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942350 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942495 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942632 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942824 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.942966 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943138 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943293 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943453 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943607 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943765 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.943908 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944075 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944254 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944392 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944536 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944716 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.944859 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945026 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945168 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945343 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945502 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945653 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.945972 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946116 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946299 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946442 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946612 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946757 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.946970 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947110 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947247 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947383 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947585 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.947887 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948025 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948246 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948420 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948650 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948816 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.948963 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.949101 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.949237 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 19:30:13.949382 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.949521 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:30:13.949675 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 19:30:14.105953 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO dbcounter [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Registered counter for database nova_api Jun 22 19:30:14.106875 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO dbcounter [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Registered counter for database nova_api Jun 22 19:30:14.129598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_db.sqlalchemy.engines [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.131481 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_db.sqlalchemy.engines [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.136501 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writer thread running {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.138127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writer thread running {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.193187 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.context [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ffa8d7d-d486-428a-890e-0435466b218e(cell1) {{(pid=104128) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 19:30:14.194992 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.context [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ffa8d7d-d486-428a-890e-0435466b218e(cell1) {{(pid=104127) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 19:30:14.197205 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:30:14.199011 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:30:14.199172 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_concurrency.lockutils [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:30:14.199811 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:30:14.200744 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_concurrency.lockutils [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:30:14.201451 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_concurrency.lockutils [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:30:14.201815 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:30:14.203554 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_concurrency.lockutils [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:30:14.203870 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO dbcounter [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Registered counter for database nova_cell0 Jun 22 19:30:14.205584 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO dbcounter [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Registered counter for database nova_cell0 Jun 22 19:30:14.208018 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO dbcounter [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Registered counter for database nova_cell1 Jun 22 19:30:14.209609 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO dbcounter [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Registered counter for database nova_cell1 Jun 22 19:30:14.215435 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_db.sqlalchemy.engines [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.217679 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_db.sqlalchemy.engines [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.221149 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_db.sqlalchemy.engines [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.221969 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_db.sqlalchemy.engines [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.222177 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writer thread running {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.229041 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writer thread running {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.230834 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writer thread running {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.360804 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writer thread running {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.370791 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO dbcounter [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Registered counter for database nova_cell0 Jun 22 19:30:14.375355 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO dbcounter [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Registered counter for database nova_cell0 Jun 22 19:30:14.380139 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_db.sqlalchemy.engines [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.384686 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG oslo_db.sqlalchemy.engines [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:30:14.385449 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writer thread running {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.389533 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writer thread running {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:30:14.729444 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: WARNING keystonemiddleware.auth_token [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:30:14.732733 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: WARNING keystonemiddleware.auth_token [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:30:14.736834 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: WARNING keystonemiddleware.auth_token [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:30:14.740014 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: WARNING keystonemiddleware.auth_token [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:30:15.074361 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: WARNING keystonemiddleware.auth_token [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:30:15.078643 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: WARNING keystonemiddleware.auth_token [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:30:15.080310 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: WARNING keystonemiddleware.auth_token [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:30:15.084629 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: WARNING keystonemiddleware.auth_token [None req-bad2b925-5f2a-41f6-995b-d86c5aa350b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:30:15.085513 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ee8f229c0 pid: 104128 (default app) Jun 22 19:30:15.087555 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:30:15.088769 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jun 22 19:30:15.089168 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Jun 22 19:30:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:30:15.089879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ee8f229c0 pid: 104127 (default app) Jun 22 19:31:29.855126 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:29.856996 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Jun 22 19:31:29.857880 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:29.873681 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_api:SELECT=3 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:29.875252 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_cell1:SELECT=3 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:29.876274 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_cell0:SELECT=3 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:29.877158 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:30.291634 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-ec166ee3-af7e-426c-8d16-2b15f8fe3af4 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:30.322793 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-ec166ee3-af7e-426c-8d16-2b15f8fe3af4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458193 Jun 22 19:31:30.323714 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jun 22 19:31:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:32.376638 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:32.377633 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-3db1a542-e9e0-40a8-9eee-6a2dc3d2bdd6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 22 19:31:32.378006 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:32.444794 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-c9c6808d-f810-4e49-a3c3-cecbb5424d27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:32.468539 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:31:32.468539 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: warnings.warn(msg) Jun 22 19:31:32.501624 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-c9c6808d-f810-4e49-a3c3-cecbb5424d27 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116647 Jun 22 19:31:32.504442 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 19:31:32.725908 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-cae29581-023e-4040-8a27-4cfcc8198601 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:32.728414 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:31:32.728414 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:31:32.731163 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_api:SELECT=3 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:32.732133 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_cell1:SELECT=3 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:32.733013 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_cell0:SELECT=3 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:32.734153 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:31:32.795120 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-cae29581-023e-4040-8a27-4cfcc8198601 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283869 Jun 22 19:31:32.798515 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jun 22 19:31:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:34.909392 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-c9c6808d-f810-4e49-a3c3-cecbb5424d27 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:34.910395 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-c9c6808d-f810-4e49-a3c3-cecbb5424d27 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 22 19:31:34.910797 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:35.021036 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-8132930f-0a65-4fbf-89db-c97d80052ba2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "id": "d1", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:35.038467 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:31:35.038467 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:31:35.058519 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-8132930f-0a65-4fbf-89db-c97d80052ba2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141659 Jun 22 19:31:35.059071 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 19:31:35.071473 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-cb6bff71-1316-4d91-8186-fb1c2ade215a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:35.073009 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:31:35.073009 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: warnings.warn(msg) Jun 22 19:31:35.108681 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-cb6bff71-1316-4d91-8186-fb1c2ade215a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041267 Jun 22 19:31:35.109259 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jun 22 19:31:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:37.168691 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-8132930f-0a65-4fbf-89db-c97d80052ba2 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:37.169734 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-8132930f-0a65-4fbf-89db-c97d80052ba2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 22 19:31:37.170366 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:37.228958 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-81379343-8dd4-405f-88e7-302bb9e5e731 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "disk": 10}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:37.247070 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-81379343-8dd4-405f-88e7-302bb9e5e731 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070986 Jun 22 19:31:37.247865 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 19:31:37.259524 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-40f13d9b-5caf-49cd-86de-3813118ab80b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:37.284654 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-40f13d9b-5caf-49cd-86de-3813118ab80b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028640 Jun 22 19:31:37.296531 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jun 22 19:31:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:39.341698 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-81379343-8dd4-405f-88e7-302bb9e5e731 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:39.342719 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-81379343-8dd4-405f-88e7-302bb9e5e731 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 22 19:31:39.343113 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:31:39.405819 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-315395bc-607b-48ca-845f-b8177e7b7a0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "swap": 0, "id": "d3", "ram": 2048}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:39.423751 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-315395bc-607b-48ca-845f-b8177e7b7a0b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074663 Jun 22 19:31:39.424329 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:31:39.436380 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-a253b2ba-93f4-48fe-9a03-9d8f78976454 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:39.459839 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-a253b2ba-93f4-48fe-9a03-9d8f78976454 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027123 Jun 22 19:31:39.460729 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jun 22 19:31:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:41.515917 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-315395bc-607b-48ca-845f-b8177e7b7a0b admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:41.516962 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-315395bc-607b-48ca-845f-b8177e7b7a0b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 22 19:31:41.517357 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:41.575044 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:41.594008 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070780 Jun 22 19:31:41.594687 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:31:41.607125 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-bb2a0c89-e227-4acc-bc31-cfaca0f3683a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:41.630857 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-bb2a0c89-e227-4acc-bc31-cfaca0f3683a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027540 Jun 22 19:31:41.631726 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jun 22 19:31:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:31:43.724786 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:43.725730 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001852 Jun 22 19:31:43.726127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:43.784915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-596f620b-9523-491a-9bd3-803cd38f2dc4 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:43.808374 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-596f620b-9523-491a-9bd3-803cd38f2dc4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076070 Jun 22 19:31:43.809002 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jun 22 19:31:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:31:45.889130 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:45.890181 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-db4db754-3f39-4282-89b9-8dc6869928ed admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Jun 22 19:31:45.890581 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:45.956331 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-39e02a4e-e246-46af-81bc-798bb5b6e417 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "swap": 0}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:45.977128 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-39e02a4e-e246-46af-81bc-798bb5b6e417 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079467 Jun 22 19:31:45.977702 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:31:45.991301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-02a20202-68c9-47a3-80d7-2b0fe3ce6b2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:46.022613 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-02a20202-68c9-47a3-80d7-2b0fe3ce6b2f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035687 Jun 22 19:31:46.023221 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jun 22 19:31:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:48.138855 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-39e02a4e-e246-46af-81bc-798bb5b6e417 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:48.140366 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-39e02a4e-e246-46af-81bc-798bb5b6e417 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jun 22 19:31:48.140920 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:48.209653 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-f0a2b5c6-20b5-474f-9e4a-b03cc585fa80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "ram": 2048, "id": "2"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:48.229884 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-f0a2b5c6-20b5-474f-9e4a-b03cc585fa80 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081064 Jun 22 19:31:48.230487 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:31:48.247228 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-1032ee66-3c17-4ac5-b961-d252c68541de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:48.277487 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-1032ee66-3c17-4ac5-b961-d252c68541de admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035329 Jun 22 19:31:48.278636 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jun 22 19:31:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:50.397909 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-f0a2b5c6-20b5-474f-9e4a-b03cc585fa80 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:50.399288 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-f0a2b5c6-20b5-474f-9e4a-b03cc585fa80 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Jun 22 19:31:50.399840 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:50.467654 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-17e436d0-74d9-43fe-a36f-1bec3e08361c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:50.487127 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-17e436d0-74d9-43fe-a36f-1bec3e08361c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079342 Jun 22 19:31:50.487909 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 19:31:50.502566 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-b060f64c-76e4-400f-b1a3-bcaac4e421bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:50.530228 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-b060f64c-76e4-400f-b1a3-bcaac4e421bd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032880 Jun 22 19:31:50.530856 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jun 22 19:31:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:52.614034 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-17e436d0-74d9-43fe-a36f-1bec3e08361c admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:52.615181 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-17e436d0-74d9-43fe-a36f-1bec3e08361c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Jun 22 19:31:52.615581 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:52.674134 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-2f12b0fd-de55-41a7-8401-4c75e3bae548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:52.693677 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-2f12b0fd-de55-41a7-8401-4c75e3bae548 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072414 Jun 22 19:31:52.694230 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:31:52.706387 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-993fac2c-4361-4ce6-96e9-e8a3b6b6c220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:52.729392 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-993fac2c-4361-4ce6-96e9-e8a3b6b6c220 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026879 Jun 22 19:31:52.729943 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jun 22 19:31:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:31:54.809875 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-2f12b0fd-de55-41a7-8401-4c75e3bae548 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:31:54.810913 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-2f12b0fd-de55-41a7-8401-4c75e3bae548 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 22 19:31:54.811310 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:31:54.886229 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:54.906174 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088772 Jun 22 19:31:54.906800 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jun 22 19:31:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 19:31:54.919877 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-4a9f00fd-8815-4b20-bc4e-d3d1d5ec9bb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:31:54.944304 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-4a9f00fd-8815-4b20-bc4e-d3d1d5ec9bb6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028269 Jun 22 19:31:54.952821 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jun 22 19:31:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:32:19.372673 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:19.373686 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 22 19:32:19.374080 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:19.385286 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:32:19.443831 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-d7e78fc0-2d31-409c-bf6b-f457a97d5994 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:19.461195 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-d7e78fc0-2d31-409c-bf6b-f457a97d5994 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080527 Jun 22 19:32:19.461946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jun 22 19:32:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:32:20.389877 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:20.390909 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-df490c64-e790-4fdb-a20c-939f18ac5bb8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 22 19:32:20.391296 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:20.587657 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-ecae1371-407a-43c3-90b3-16ded2234e31 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:20.596606 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.wsgi [None req-ecae1371-407a-43c3-90b3-16ded2234e31 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-ecae1371-407a-43c3-90b3-16ded2234e31 admin admin] Request method failure captured: Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept: application/json Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept-Encoding: gzip, deflate Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Connection: keep-alive Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Content-Length: 0 Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Host: 10.222.0.26 Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-System-Scope: None Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: User-Agent: python-novaclient Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Auth-Token: gAAAAABis25EXO39-D8GFF0BNu4me7ri3evuTe_34qIi0Qb9NscNqJxr7xpG2b0yhS4j2i2dU1U4jto3g8UUKx_nh2AZuXaQZXGJ-OizVQS3Pkhz5g0UDVuGKWNJlhl-ncA2wA1cL-BKS0uUGQSCcxAIahgFiBeZ2KJfnBB5iNGmmBg2HcsSzzY Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Id: None Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Name: None Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Identity-Status: Confirmed Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Is-Admin-Project: True Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Id: default Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Name: Default Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Name: admin Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Role: admin,reader,member Jun 22 19:32:20.601301 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Roles: admin,reader,member Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant: admin Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Name: admin Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User: admin Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Id: default Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Name: Default Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Name: admin Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: method: > Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: exception: Flavor 42 could not be found. Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: action_args: {'id': '42'} Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:20.602900 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:20.603846 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.605052 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-ecae1371-407a-43c3-90b3-16ded2234e31 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:20.606155 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-ecae1371-407a-43c3-90b3-16ded2234e31 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074805 Jun 22 19:32:20.606155 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jun 22 19:32:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:20.612555 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-bbb71088-5688-4aa4-b6ac-2383962053b3 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:20.615543 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:32:20.634981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-bbb71088-5688-4aa4-b6ac-2383962053b3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026030 Jun 22 19:32:20.635516 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:32:20.645388 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-dbfbd48b-3726-4ed4-930d-c159c4b3bf0c admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:20.669316 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-dbfbd48b-3726-4ed4-930d-c159c4b3bf0c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027401 Jun 22 19:32:20.669877 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:32:20.682173 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-841437da-b46e-4d70-9f96-fd3291f991ac admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:20.691194 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.wsgi [None req-841437da-b46e-4d70-9f96-fd3291f991ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-841437da-b46e-4d70-9f96-fd3291f991ac admin admin] Request method failure captured: Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept: application/json Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept-Encoding: gzip, deflate Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Connection: keep-alive Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Content-Length: 0 Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Host: 10.222.0.26 Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-System-Scope: None Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: User-Agent: python-novaclient Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Auth-Token: gAAAAABis25EXO39-D8GFF0BNu4me7ri3evuTe_34qIi0Qb9NscNqJxr7xpG2b0yhS4j2i2dU1U4jto3g8UUKx_nh2AZuXaQZXGJ-OizVQS3Pkhz5g0UDVuGKWNJlhl-ncA2wA1cL-BKS0uUGQSCcxAIahgFiBeZ2KJfnBB5iNGmmBg2HcsSzzY Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Id: None Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Name: None Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Identity-Status: Confirmed Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Is-Admin-Project: True Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Id: default Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Name: Default Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Name: admin Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Role: admin,reader,member Jun 22 19:32:20.695065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Roles: admin,reader,member Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant: admin Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Name: admin Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User: admin Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Id: default Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Name: Default Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Name: admin Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: method: > Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: exception: Flavor 42 could not be found. Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: action_args: {'id': '42'} Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:20.696535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:20.697598 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:20.698981 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-841437da-b46e-4d70-9f96-fd3291f991ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:20.700275 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-841437da-b46e-4d70-9f96-fd3291f991ac admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020127 Jun 22 19:32:20.700275 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jun 22 19:32:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:21.538129 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-dbfbd48b-3726-4ed4-930d-c159c4b3bf0c admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:21.539147 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-dbfbd48b-3726-4ed4-930d-c159c4b3bf0c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 22 19:32:21.539540 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:21.741676 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-d11427a2-0ef6-414f-8575-8832dd36f237 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:21.747849 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.wsgi [None req-d11427a2-0ef6-414f-8575-8832dd36f237 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-d11427a2-0ef6-414f-8575-8832dd36f237 admin admin] Request method failure captured: Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept: application/json Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept-Encoding: gzip, deflate Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Connection: keep-alive Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Content-Length: 0 Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Host: 10.222.0.26 Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-System-Scope: None Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: User-Agent: python-novaclient Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Auth-Token: gAAAAABis25FdUmlKbLmjfPVSkS17krj5Bc059q0CApEf30fZizwbil72ysSczBYPDX0wh5m22mGZnV8ZrB2ffr0xMhSahKlmgxx_wBL_8HZ99ZEPu5WJI4_m1r42kwidsE1KBVW29NxXgssMgHhRU-1wcL6pb3NGoP-pA_h2ivRZMQl7ghqVOY Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Id: None Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Name: None Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Identity-Status: Confirmed Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Is-Admin-Project: True Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Id: default Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Name: Default Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Name: admin Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Role: admin,reader,member Jun 22 19:32:21.749431 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Roles: admin,reader,member Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant: admin Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Name: admin Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User: admin Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Id: default Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Name: Default Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Name: admin Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: method: > Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: exception: Flavor 84 could not be found. Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: action_args: {'id': '84'} Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:21.750974 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:21.751777 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.752872 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-d11427a2-0ef6-414f-8575-8832dd36f237 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:21.753915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-d11427a2-0ef6-414f-8575-8832dd36f237 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.074430 Jun 22 19:32:21.753915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jun 22 19:32:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:21.760862 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-712cdc38-7f7e-47a0-851d-ec17f102ffc7 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:21.774779 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-712cdc38-7f7e-47a0-851d-ec17f102ffc7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017587 Jun 22 19:32:21.775296 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:32:21.784798 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-d1ff9506-8672-4125-9ac5-097b6a283549 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:21.800206 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-d1ff9506-8672-4125-9ac5-097b6a283549 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018934 Jun 22 19:32:21.800731 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:32:21.810295 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-14243667-3825-41e9-a50c-5c6405e0e80f admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:21.815931 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.wsgi [None req-14243667-3825-41e9-a50c-5c6405e0e80f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-14243667-3825-41e9-a50c-5c6405e0e80f admin admin] Request method failure captured: Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept: application/json Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept-Encoding: gzip, deflate Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Connection: keep-alive Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Content-Length: 0 Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Host: 10.222.0.26 Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-System-Scope: None Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: User-Agent: python-novaclient Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Auth-Token: gAAAAABis25FdUmlKbLmjfPVSkS17krj5Bc059q0CApEf30fZizwbil72ysSczBYPDX0wh5m22mGZnV8ZrB2ffr0xMhSahKlmgxx_wBL_8HZ99ZEPu5WJI4_m1r42kwidsE1KBVW29NxXgssMgHhRU-1wcL6pb3NGoP-pA_h2ivRZMQl7ghqVOY Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Id: None Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Name: None Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Identity-Status: Confirmed Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Is-Admin-Project: True Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Id: default Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Name: Default Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Name: admin Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Role: admin,reader,member Jun 22 19:32:21.817483 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Roles: admin,reader,member Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant: admin Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Name: admin Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User: admin Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Id: default Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Name: Default Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Name: admin Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: method: > Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: exception: Flavor 84 could not be found. Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: action_args: {'id': '84'} Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:21.818946 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:21.819879 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:21.821127 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-14243667-3825-41e9-a50c-5c6405e0e80f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:21.822343 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-14243667-3825-41e9-a50c-5c6405e0e80f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012068 Jun 22 19:32:21.822343 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jun 22 19:32:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:22.648726 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-d1ff9506-8672-4125-9ac5-097b6a283549 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:22.650292 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-d1ff9506-8672-4125-9ac5-097b6a283549 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Jun 22 19:32:22.650950 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:22.859886 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-d07b3894-f8ac-469c-bc3a-022ac92280a9 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:22.865803 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.wsgi [None req-d07b3894-f8ac-469c-bc3a-022ac92280a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-d07b3894-f8ac-469c-bc3a-022ac92280a9 admin admin] Request method failure captured: Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept: application/json Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Accept-Encoding: gzip, deflate Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Connection: keep-alive Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Content-Length: 0 Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Host: 10.222.0.26 Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Openstack-System-Scope: None Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: User-Agent: python-novaclient Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Auth-Token: gAAAAABis25GX_CrOKsRd9LgYV7b7ZOLRBDdbblkK0r8PM6jivEcJCRmiyqOl00AGO4i5tqHbOmnezzcYtwPQej-Q_galfTXLd_af6-I03CAdUuX3LY0ceQE_VsTyDwpftZYtsajnluZ16l_A8V4OFWkv_dswwUPd4DaQglsFFj8HeuANMWP4Iw Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Id: None Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Domain-Name: None Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Identity-Status: Confirmed Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Is-Admin-Project: True Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Id: default Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Domain-Name: Default Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Project-Name: admin Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Role: admin,reader,member Jun 22 19:32:22.867313 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Roles: admin,reader,member Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant: admin Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-Tenant-Name: admin Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User: admin Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Id: default Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Domain-Name: Default Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: X-User-Name: admin Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: method: > Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: exception: Flavor 451 could not be found. Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: action_args: {'id': '451'} Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:22.868811 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:22.869717 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.871061 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-d07b3894-f8ac-469c-bc3a-022ac92280a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:22.872285 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-d07b3894-f8ac-469c-bc3a-022ac92280a9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069610 Jun 22 19:32:22.872285 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:32:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:22.881361 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-5995fb04-1396-4cd4-ad4f-57134b3de2a9 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:22.895740 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-5995fb04-1396-4cd4-ad4f-57134b3de2a9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019738 Jun 22 19:32:22.896376 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:32:22.906031 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:22.920403 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017965 Jun 22 19:32:22.920926 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jun 22 19:32:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:32:22.933206 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-b3d3de61-ea7a-4299-a0ba-1991d80e6a38 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:22.941812 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.wsgi [None req-b3d3de61-ea7a-4299-a0ba-1991d80e6a38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-b3d3de61-ea7a-4299-a0ba-1991d80e6a38 admin admin] Request method failure captured: Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept: application/json Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Accept-Encoding: gzip, deflate Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Connection: keep-alive Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Content-Length: 0 Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Host: 10.222.0.26 Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-Api-Version: compute 2.90 Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Openstack-System-Scope: None Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: User-Agent: python-novaclient Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Auth-Token: gAAAAABis25GX_CrOKsRd9LgYV7b7ZOLRBDdbblkK0r8PM6jivEcJCRmiyqOl00AGO4i5tqHbOmnezzcYtwPQej-Q_galfTXLd_af6-I03CAdUuX3LY0ceQE_VsTyDwpftZYtsajnluZ16l_A8V4OFWkv_dswwUPd4DaQglsFFj8HeuANMWP4Iw Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Id: None Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Domain-Name: None Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Identity-Status: Confirmed Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Is-Admin-Project: True Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Id: default Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Domain-Name: Default Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Project-Name: admin Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Role: admin,reader,member Jun 22 19:32:22.943600 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Roles: admin,reader,member Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87fb30706c0f465ba99c518f069d320f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87fb30706c0f465ba99c518f069d320f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant: admin Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Id: 87fb30706c0f465ba99c518f069d320f Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-Tenant-Name: admin Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User: admin Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Id: default Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Domain-Name: Default Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Id: fca4692d28f847a089077c49c45aeec4 Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: X-User-Name: admin Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: method: > Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: exception: Flavor 451 could not be found. Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: action_args: {'id': '451'} Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:32:22.945697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:22.947029 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: ERROR nova.api.openstack.wsgi Jun 22 19:32:22.948624 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-b3d3de61-ea7a-4299-a0ba-1991d80e6a38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:32:22.950546 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-b3d3de61-ea7a-4299-a0ba-1991d80e6a38 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018001 Jun 22 19:32:22.950546 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:32:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 19:32:23.777245 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:23.778266 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 22 19:32:23.778657 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:23.984061 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-24de6ec3-c92b-433d-bab9-2b7ab93d0886 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:32:24.006082 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-24de6ec3-c92b-433d-bab9-2b7ab93d0886 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090668 Jun 22 19:32:24.006615 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jun 22 19:32:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:32:24.830460 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:24.831471 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 22 19:32:24.831858 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:25.035573 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-f5c2d403-37d0-417b-854e-81133090faf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:32:25.056067 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-f5c2d403-37d0-417b-854e-81133090faf9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082309 Jun 22 19:32:25.056789 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jun 22 19:32:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:32:25.887448 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:25.888502 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 22 19:32:25.888904 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:26.080949 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-ec109e72-00a6-48d7-a0ac-e8e63b984ddf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:32:26.100142 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-ec109e72-00a6-48d7-a0ac-e8e63b984ddf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075886 Jun 22 19:32:26.100963 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jun 22 19:32:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:32:26.942411 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:26.944023 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Jun 22 19:32:26.944702 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:27.162452 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-a141bd04-2562-452d-be9d-00d2c098b39c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:32:27.182537 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-a141bd04-2562-452d-be9d-00d2c098b39c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.091822 Jun 22 19:32:27.183075 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jun 22 19:32:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:32:28.016916 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:28.018038 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jun 22 19:32:28.018487 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:32:28.213708 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-6d3e37cd-514a-4e3c-8fc2-a82aa15f6c6b admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:32:28.233344 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-6d3e37cd-514a-4e3c-8fc2-a82aa15f6c6b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077224 Jun 22 19:32:28.233804 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Jun 22 19:32:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:33:15.011902 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.012979 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-75ebe47c-1ec1-429f-91e3-5b2e17f65e91 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 22 19:33:15.013382 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:33:15.023830 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:33:15.075362 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-5337fc30-7de1-4632-911d-8bdc43110ffc admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.094387 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-5337fc30-7de1-4632-911d-8bdc43110ffc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075192 Jun 22 19:33:15.094914 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:33:15.118464 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-3f7a8eec-7c19-4bca-a462-c6e8848e518c admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.121945 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG dbcounter [-] [104127] Writing DB stats nova_api:SELECT=14 {{(pid=104127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:33:15.127664 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-3f7a8eec-7c19-4bca-a462-c6e8848e518c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012893 Jun 22 19:33:15.128208 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:33:15.142489 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-8b69d35f-1086-42f9-ba1e-4b3b1f4c069a admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.151685 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-8b69d35f-1086-42f9-ba1e-4b3b1f4c069a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015191 Jun 22 19:33:15.152225 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:33:15.165251 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.174571 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014233 Jun 22 19:33:15.175093 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:33:15.189721 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-af113b35-5309-4c72-a5a3-3cf04682bdb1 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:33:15.201296 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-af113b35-5309-4c72-a5a3-3cf04682bdb1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017454 Jun 22 19:33:15.202065 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Wed Jun 22 19:33:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:36:35.651680 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:35.652746 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 22 19:36:35.653134 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:36:35.805935 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_api:SELECT=6 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:36:35.930350 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:35.931507 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:36:35.931507 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:36:35.932727 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:35.933157 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:35.933926 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:35.934340 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:35.968707 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-87f59093-bd81-42f6-aa4a-2383eec7fe81 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164193 Jun 22 19:36:35.969266 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:36:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:36:36.796049 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:36.797257 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jun 22 19:36:36.797650 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:36:37.003644 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:37.004782 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:36:37.004782 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:36:37.005993 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:37.006429 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:37.007219 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:37.007648 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:37.026697 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-e4c8c6bc-ac11-4b2b-904f-a17d1a25388c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080978 Jun 22 19:36:37.027229 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:36:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:36:48.292412 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:48.293470 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jun 22 19:36:48.293859 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:36:48.435201 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_cell0:SELECT=4 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:36:48.435915 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_cell1:SELECT=4 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:36:48.436538 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG dbcounter [-] [104128] Writing DB stats nova_api:SELECT=8 {{(pid=104128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:36:48.490644 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:48.491848 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:36:48.491848 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:36:48.493187 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:48.493560 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:48.494404 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:48.494832 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:48.519310 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-ab731cfc-6e5c-4d97-b81d-edc245d1171b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088527 Jun 22 19:36:48.519827 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:36:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:36:49.337155 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: DEBUG nova.api.openstack.wsgi [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] Calling method '>' {{(pid=104127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:49.338254 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: INFO nova.api.openstack.requestlog [None req-adc6774e-41b7-45c7-8e72-a3b68aa448c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 22 19:36:49.338625 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: [pid: 104127|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jun 22 19:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:36:49.529145 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG nova.api.openstack.wsgi [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] Calling method '>' {{(pid=104128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:36:49.530311 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 19:36:49.530311 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: warnings.warn(msg) Jun 22 19:36:49.531535 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:49.531983 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:49.532797 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:36:49.533260 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: DEBUG oslo_concurrency.lockutils [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:36:49.554874 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: INFO nova.api.openstack.requestlog [None req-9954c70c-66ab-4c5d-9316-7108e2fe2360 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077891 Jun 22 19:36:49.555352 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: [pid: 104128|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jun 22 19:36:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:37:46.096951 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: Wed Jun 22 19:37:46 2022 - graceful shutdown triggered... Jun 22 19:37:46.096636 dv-cinder-847216-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 19:37:46.098351 dv-cinder-847216-1-iscsi devstack@n-api.service[104128]: Gracefully killing worker 2 (pid: 104128)... Jun 22 19:37:46.100865 dv-cinder-847216-1-iscsi devstack@n-api.service[104127]: Gracefully killing worker 1 (pid: 104127)... Jun 22 19:37:47.096955 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: worker 1 buried after 1 seconds Jun 22 19:37:47.096955 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: worker 2 buried after 1 seconds Jun 22 19:37:47.096955 dv-cinder-847216-1-iscsi devstack@n-api.service[104122]: goodbye to uWSGI. Jun 22 19:37:47.099061 dv-cinder-847216-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 19:37:47.099841 dv-cinder-847216-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 19:37:47.102977 dv-cinder-847216-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 19:37:47.112963 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 19:37:47 2022] *** Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: nodename: dv-cinder-847216-1-iscsi Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: machine: x86_64 Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: clock source: unix Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: pcre jit disabled Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: detected number of CPU cores: 4 Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: current working directory: / Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: detected binary path: /usr/bin/uwsgi-core Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: your processes number limit is 47680 Jun 22 19:37:47.115634 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: your memory page size is 4096 bytes Jun 22 19:37:47.116501 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: detected max file descriptor number: 2048 Jun 22 19:37:47.116501 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: lock engine: pthread robust mutexes Jun 22 19:37:47.116501 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: thunder lock: enabled Jun 22 19:37:47.116501 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 19:37:47.116501 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 19:37:47.159664 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: Python main interpreter initialized at 0x559368e599c0 Jun 22 19:37:47.159664 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: python threads support enabled Jun 22 19:37:47.159664 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: your server socket listen backlog is limited to 100 connections Jun 22 19:37:47.159664 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: your mercy for graceful operations on workers is 90 seconds Jun 22 19:37:47.160163 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 19:37:47.160163 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: *** Operational MODE: preforking *** Jun 22 19:37:47.160401 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: *** uWSGI is running in multiple interpreter mode *** Jun 22 19:37:47.160401 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: spawned uWSGI master process (pid: 124839) Jun 22 19:37:47.160627 dv-cinder-847216-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 19:37:47.167190 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: spawned uWSGI worker 1 (pid: 124856, cores: 1) Jun 22 19:37:47.167190 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: spawned uWSGI worker 2 (pid: 124857, cores: 1) Jun 22 19:37:47.167190 dv-cinder-847216-1-iscsi devstack@n-api.service[124839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 19:37:47.810573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 19:37:47.811824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 19:37:48.992436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:37:48.992436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: from cryptography.utils import int_from_bytes Jun 22 19:37:48.993194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:37:48.993194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: from cryptography.utils import int_from_bytes Jun 22 19:37:48.993194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:37:48.993194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: from cryptography.utils import int_from_bytes Jun 22 19:37:48.993709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 19:37:48.993709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: from cryptography.utils import int_from_bytes Jun 22 19:37:51.355430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 19:37:51.355989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 19:37:51.356213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 19:37:51.356608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 19:37:51.356860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 19:37:51.357256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.357584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.357908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.358234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.358566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.358880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.359199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.359507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.359849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.360138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.360439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.360768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-1-iscsi {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.361095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.361406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.361722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.361834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 19:37:51.362247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.362347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 19:37:51.362435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.362577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 19:37:51.362694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.362941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.363049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 19:37:51.363194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 19:37:51.363447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.363567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.363884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.364966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365844 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.365957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.366864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-1-iscsi {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-1-iscsi {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.367998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.368947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.369146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.369246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.369460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.369731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.369853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.370962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.371894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.372985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-1-iscsi {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.373892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.374993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.375882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.376066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.376232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.384997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.385929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.386947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.387982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388771 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.388941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.389924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390137 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390137 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.390951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391031 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.391993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.392065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.393958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.394715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.395135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.395287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.395577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.395738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.395891 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.396862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.397943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.398119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.398857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.399948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.400919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.401146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.401387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.401616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.401840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.402075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.402308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.402548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.402794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.403036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.403270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.403524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.403769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.404013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.404331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.404603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.404850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.405107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.405349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.405837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.406099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.406323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.406554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.406774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.406992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.407203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.407484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.407786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.407955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.408136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.408136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.408136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.408696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.408843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.408843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.409123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.409273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.409431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.409582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.409788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.410130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.410326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.410472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.410631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.410821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 19:37:51.411038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.411192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.411345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.411504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.411713 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.411865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.412864 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413008 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.413895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.414948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.415987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.416324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.416471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.416615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.416766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.416766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.417732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418658 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.418963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.419870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.420850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.421966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.422875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.423937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.424884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.425786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.426870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.427831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.428296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.428462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.428622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.428776 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.428920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.429969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.430871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.431923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.432985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.433129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.433273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.433426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.433579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.433873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.434969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.435874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.436969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.437880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.438780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439376 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.439980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.440938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.441995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.442141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.442295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.442461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.442620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.442849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.443967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.444135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.444288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.444457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.444656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.444854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.445970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.446196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.446652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.446900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.447254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.447481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.447481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.447772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.447971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.448293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.448705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.448961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.449232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.449447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.449695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.449948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.450843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.451880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.452155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.452155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.452632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.452918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.452918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453697 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.453994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.454919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.455981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.456151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.456302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.456302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.456938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.457999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.458994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.459865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.460851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.461910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.462955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.463867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.464944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.465870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.466070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.467442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.468592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.469786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.469786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.469786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.469786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.469786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.471854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.472838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.473829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.474233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.474406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.474558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.474710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.474862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.475993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.476225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.476384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.476536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.476694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.476874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.477190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.477676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.477843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.477995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.478957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.479896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.480948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.481123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.481394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.481581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.481744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.481896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.482985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.483921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.484455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.484606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.484757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.484928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.485848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486006 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.486870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.487984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.488165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.488333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.488485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.488762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.488945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489100 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.489919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.490848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.491943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.492911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493408 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.493880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.494669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.495893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496277 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.496902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.497076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.497230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.497552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.497710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.497869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.498974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.499940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.500923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.501860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.502019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.502170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.502320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.502471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.505195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.505471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.505642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.505817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.505989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.506921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.507714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.508214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.508385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.508385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.508685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.508844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.509927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.510585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.511976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.512206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.512377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.512528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.512687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.512852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.513964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.514925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.515670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.515834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.515986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516334 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.516966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.517946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.518911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.519619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.520242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.520398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.520559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.520723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.520885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.521861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.522977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.523276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.523276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.523575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.523575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.523870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.524910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.525874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.526041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.526200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.526353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.527120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.527290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.527290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.527290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.527738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.528932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.529849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.530808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531112 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.531922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.532934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.533085 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.533250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.533410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.533586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.533748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.534857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.535021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.535173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.535350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.535704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.535704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.536741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.537378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.538747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.539533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.539649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.539649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.539875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.539875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.540093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.544540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.544744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.544744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.545885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.546910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.547975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.548955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.549887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.550905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551155 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.551967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.552078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.552239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.552370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.552506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.552634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.554957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.555812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.556625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.556738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.556738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.556738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.557972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.558887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.559938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.560091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.560307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.560616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.561808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.562966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.563768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564475 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.564942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.565095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.565260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.565581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.565902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.566218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.566477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.566636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.566832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.567974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.568233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.568402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.568585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.568740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.568891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.569884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.570047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.570201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.570419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.570621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.570909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.571866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.572883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.573979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.574993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.575152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.575910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.576070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.576070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.576553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.576710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.576710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.577009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.577410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.577583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.577743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.577906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.578922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.579888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.580038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.580216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.580380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.580542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.580700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.581043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.581207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.581207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.581690 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.581865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.582890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.583196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.583196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.583540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.583696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.583863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.584867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.585976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.586816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.587280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.587433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.587591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.587743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.587743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.588950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.589994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.590191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.590315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.590523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.590689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.590821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.591888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.592870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.593818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.594997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.595975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.596322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.596441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.596667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.596872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.596980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.597967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.598897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.599919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.600963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.601943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.602033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.602263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.602666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.602903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.603826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.604938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.605900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.606988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.607939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.608191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.608297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.608533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.608717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.608850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609668 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.609978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.610926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.611056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.611249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.611393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.611563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.611888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.612250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.612378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.612579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.612714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.612902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.613816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.614867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.615980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.616146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.616307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.616452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.616611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.616989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.617923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.618988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.619414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.619719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.620948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.621967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.622953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.623886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.624132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.624272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.624448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.624766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.625080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.625381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.625500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.625700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.625803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.626793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.627949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.628901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.629845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.630892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631183 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.631798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.632986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.633945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.634913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.635953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.636198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.636311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.636506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.636604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.636748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 19:37:51.636936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.637271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.637585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.637916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.638242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.638566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.638889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.639204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.639540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.639855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.640192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.640515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.640830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.641150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.641471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.641791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.642122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.642452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.642768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.643132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.643425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.643777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.644124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.644498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.644830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.645155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.645464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.645791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 19:37:51.646062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 19:37:51.697868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO dbcounter [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Registered counter for database nova_api Jun 22 19:37:51.706924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO dbcounter [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Registered counter for database nova_api Jun 22 19:37:51.718167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_db.sqlalchemy.engines [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.725106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writer thread running {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.727638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.734631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writer thread running {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.781551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.context [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ffa8d7d-d486-428a-890e-0435466b218e(cell1) {{(pid=124856) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 19:37:51.785696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:37:51.787334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:37:51.788146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:37:51.790116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:37:51.791045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.context [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4ffa8d7d-d486-428a-890e-0435466b218e(cell1) {{(pid=124857) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 19:37:51.792128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO dbcounter [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Registered counter for database nova_cell0 Jun 22 19:37:51.795344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:37:51.796116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO dbcounter [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Registered counter for database nova_cell1 Jun 22 19:37:51.797001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:37:51.797814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:37:51.799833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:37:51.801925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO dbcounter [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Registered counter for database nova_cell0 Jun 22 19:37:51.803571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_db.sqlalchemy.engines [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.806217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_db.sqlalchemy.engines [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.806374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO dbcounter [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Registered counter for database nova_cell1 Jun 22 19:37:51.810445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writer thread running {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.813894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.815958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.823080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writer thread running {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.824397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writer thread running {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.950473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writer thread running {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.960726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO dbcounter [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Registered counter for database nova_cell0 Jun 22 19:37:51.967753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_db.sqlalchemy.engines [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.972647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writer thread running {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:51.973114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO dbcounter [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Registered counter for database nova_cell0 Jun 22 19:37:51.980136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_db.sqlalchemy.engines [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 19:37:51.984703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writer thread running {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 19:37:52.300813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: WARNING keystonemiddleware.auth_token [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:37:52.303527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: WARNING keystonemiddleware.auth_token [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:37:52.308134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: WARNING keystonemiddleware.auth_token [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:37:52.310878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: WARNING keystonemiddleware.auth_token [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:37:52.647034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: WARNING keystonemiddleware.auth_token [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:37:52.649669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: WARNING keystonemiddleware.auth_token [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 19:37:52.653076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: WARNING keystonemiddleware.auth_token [None req-6cf7ce8b-18eb-46a8-ac4f-bf16c6b74140 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:37:52.656189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: WARNING keystonemiddleware.auth_token [None req-14e180d6-95cd-4da8-adca-a9c1602a4ee6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 19:37:52.658403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559368e599c0 pid: 124857 (default app) Jun 22 19:37:52.661487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559368e599c0 pid: 124856 (default app) Jun 22 19:38:33.248994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:33.250000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:33.251239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:33.252460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:34.314502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-198bb10b-ac4f-462d-800d-ed7291f55a7e tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Action: 'create', calling method: .version_select at 0x7fdc1bc45700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-734155435", "metadata": {"Type": "work"}}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-198bb10b-ac4f-462d-800d-ed7291f55a7e tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 121 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:38:34.350734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-734155435", "metadata": {"Type": "work"}}} Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: Jun 22 19:38:34.352578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-734155435', 'metadata': {'Type': 'work'}}}} Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise error Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:34.353573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 19:38:34.354910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 19:38:34.356177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 19:38:34.356177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.356177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-198bb10b-ac4f-462d-800d-ed7291f55a7e tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:34.356177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-198bb10b-ac4f-462d-800d-ed7291f55a7e tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.116642 Jun 22 19:38:34.356177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jun 22 19:38:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 19:38:34.924850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3d4d8d54-1970-4123-9d11-3247c3692cf4 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Action: 'create', calling method: .version_select at 0x7fdc1bc92040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1438984426", "metadata": {"Type": "work"}}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3d4d8d54-1970-4123-9d11-3247c3692cf4 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 120 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:38:34.929912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1438984426", "metadata": {"Type": "work"}}} Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 19:38:34.931269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1438984426', 'metadata': {'Type': 'work'}}}} Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise error Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi '0' Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:34.932029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 19:38:34.933875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 19:38:34.934933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 19:38:34.934933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.936459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3d4d8d54-1970-4123-9d11-3247c3692cf4 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:34.937881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3d4d8d54-1970-4123-9d11-3247c3692cf4 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.577512 Jun 22 19:38:34.939066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jun 22 19:38:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:38:34.950423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dcaec114-6f05-4196-aa7a-10a656c04922 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Action: 'create', calling method: .version_select at 0x7fdc1bbc19d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1663744846", "metadata": {"Type": "work"}}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dcaec114-6f05-4196-aa7a-10a656c04922 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 119 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:38:34.953217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1663744846", "metadata": {"Type": "work"}}} Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: Jun 22 19:38:34.954497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1663744846', 'metadata': {'Type': 'work'}}}} Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise error Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi '' Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:34.955275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 19:38:34.957097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 19:38:34.958204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 19:38:34.958204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:34.958204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dcaec114-6f05-4196-aa7a-10a656c04922 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:34.958204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dcaec114-6f05-4196-aa7a-10a656c04922 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010075 Jun 22 19:38:34.958768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jun 22 19:38:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:38:34.964672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:34.965773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:34.966501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:34.967588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:34.973262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-834cd75b-0b38-4dfc-8dae-ce0774be7597 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Calling method '.version_select at 0x7fdc1c470c10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:35.499419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-834cd75b-0b38-4dfc-8dae-ce0774be7597 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] HTTP exception thrown: Volume tempest-invalid-257171996 could not be found. Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-834cd75b-0b38-4dfc-8dae-ce0774be7597 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-257171996 HTTP/1.1 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:38:35.503841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Volume tempest-invalid-257171996 could not be found. Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'tempest-invalid-257171996'} Jun 22 19:38:35.505575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-257171996 could not be found. (HTTP 404) (Request-ID: req-5ef4186e-2d5d-484b-9363-62a053f9aece) Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.506503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 19:38:35.507916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-257171996 could not be found. Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:38:35.509337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-257171996 could not be found. Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-257171996 could not be found. Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-834cd75b-0b38-4dfc-8dae-ce0774be7597 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 404 to user: Volume tempest-invalid-257171996 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-834cd75b-0b38-4dfc-8dae-ce0774be7597 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-257171996" status: 404 len: 98 microversion: 2.1 time: 0.542047 Jun 22 19:38:35.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1214 bytes} [Wed Jun 22 19:38:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-257171996 => generated 98 bytes in 544 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 19:38:35.517526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a4543912-0573-46a5-bfd7-72a3609cf416 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005809 Jun 22 19:38:35.518626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1139 bytes} [Wed Jun 22 19:38:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 19:38:35.533588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6be7f0fb-26b9-4d5f-a531-f886ccde3fc5 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004518 Jun 22 19:38:35.534709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1136 bytes} [Wed Jun 22 19:38:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 19:38:35.545581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1755fbe6-0676-4487-808e-bacbd28db167 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Calling method '.version_select at 0x7fdc1bc45670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:35.866274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-1755fbe6-0676-4487-808e-bacbd28db167 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] HTTP exception thrown: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1755fbe6-0676-4487-808e-bacbd28db167 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/os-volumes/e31f3650-ba8d-4555-a6b8-317e5b3bc207 HTTP/1.1 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:38:35.871861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'e31f3650-ba8d-4555-a6b8-317e5b3bc207'} Jun 22 19:38:35.873212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. (HTTP 404) (Request-ID: req-a885886c-9bdc-4d2c-8d86-ac4264fd8be0) Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.873979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 19:38:35.881018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 19:38:35.883041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1755fbe6-0676-4487-808e-bacbd28db167 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 404 to user: Volume e31f3650-ba8d-4555-a6b8-317e5b3bc207 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1755fbe6-0676-4487-808e-bacbd28db167 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e31f3650-ba8d-4555-a6b8-317e5b3bc207" status: 404 len: 109 microversion: 2.1 time: 0.331959 Jun 22 19:38:35.885223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 19:38:35 2022] DELETE /compute/v2.1/os-volumes/e31f3650-ba8d-4555-a6b8-317e5b3bc207 => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:38:35.886265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-debe12fc-cc60-4925-b562-7fbee5e24a97 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Calling method '.version_select at 0x7fdc1ba71dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:35.921320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-debe12fc-cc60-4925-b562-7fbee5e24a97 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] HTTP exception thrown: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-debe12fc-cc60-4925-b562-7fbee5e24a97 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Request method failure captured: Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/os-volumes/baf12f6e-68ec-4c24-84de-65a8ab5abdea HTTP/1.1 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2-58sNej2qzzhoQJ9xbP8bLqqJhN23AI5Z5gMk2HyQxKaWhFd2V-VfS-wM7zhKkkK0fJ0HTfp4CO5nb28BKHKsW76Gw6EMqcuSh25Gx1pAPG9obVU0oq4nymHjDK5wqF1fpsVj4ZD_8Ia2aCe39Erw_BE5xsLf5LCMsEs0ZXzgydo8 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:38:35.924219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dfde7e207c8b49169449fea4762538b8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dfde7e207c8b49169449fea4762538b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: dfde7e207c8b49169449fea4762538b8 Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesNegativeTest-1744038275 Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 16a7b44527ee417687448e557bbc5611 Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesNegativeTest-1744038275-project Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'baf12f6e-68ec-4c24-84de-65a8ab5abdea'} Jun 22 19:38:35.926640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. (HTTP 404) (Request-ID: req-6d82569b-7c5b-4083-87e2-a3d4d8a3d451) Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.927670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 19:38:35.929809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 19:38:35.932089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-debe12fc-cc60-4925-b562-7fbee5e24a97 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] Returning 404 to user: Volume baf12f6e-68ec-4c24-84de-65a8ab5abdea could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-debe12fc-cc60-4925-b562-7fbee5e24a97 tempest-VolumesNegativeTest-1744038275 tempest-VolumesNegativeTest-1744038275-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/baf12f6e-68ec-4c24-84de-65a8ab5abdea" status: 404 len: 109 microversion: 2.1 time: 0.053170 Jun 22 19:38:35.936674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 19:38:35 2022] GET /compute/v2.1/os-volumes/baf12f6e-68ec-4c24-84de-65a8ab5abdea => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:38:36.628609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8563bc67-ded5-4869-bdff-46b85fa36b5c tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1bc45790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:36.776247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8563bc67-ded5-4869-bdff-46b85fa36b5c tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2d658747-1492-4894-a5a4-52a65046b785" status: 200 len: 350 microversion: 2.1 time: 0.152231 Jun 22 19:38:36.777542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 19:38:36 2022] GET /compute/v2.1/os-volumes/2d658747-1492-4894-a5a4-52a65046b785 => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:39.508081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1b1c5921-caec-4ed9-a9a7-60561f36944a tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1ba989d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:39.752805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1b1c5921-caec-4ed9-a9a7-60561f36944a tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/17a6c1e1-f51a-4b98-9068-049cd3485c9e" status: 200 len: 351 microversion: 2.1 time: 0.252361 Jun 22 19:38:39.753805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 19:38:39 2022] GET /compute/v2.1/os-volumes/17a6c1e1-f51a-4b98-9068-049cd3485c9e => generated 351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:44.156020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d7252073-95f1-4445-a4b2-1a9e8df372e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'create', calling method: .version_select at 0x7fdc1baa1700>, body: {"keypair": {"name": "tempest-keypair-1858010710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXILm5nz+FVcoybM1zAEmHONRcnehnykqTvRrOpBlkS9jxijaB0ZahslfF6bNeMOwaWiq6imkzE2a7EjaNRp+6mb9EPum0GVo60H+/929NJLmQDTb4AXZK5+6X2d/EHdg=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:44.244377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d7252073-95f1-4445-a4b2-1a9e8df372e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for project b90964fa17494782b2a49ff54cfede88. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:44.254795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d7252073-95f1-4445-a4b2-1a9e8df372e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for user 20ef6f7c907b407b9d76bc814749d403 and project b90964fa17494782b2a49ff54cfede88. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:44.350763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d7252073-95f1-4445-a4b2-1a9e8df372e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.448262 Jun 22 19:38:44.351631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 6/11] 10.222.0.26 () {62 vars in 1199 bytes} [Wed Jun 22 19:38:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 19:38:46.529911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-be2037ce-3d7c-4d0d-ae64-2a26acb3f26f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: .version_select at 0x7fdc1ba71b80>, body: {"keypair": {"name": "tempest-keypair-1394153160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyhJ3Vi783sX2yt3tA60HWYfUralt6IDUf8jmq346KgmWxpfMHpEdYg9zK2dck3edthbD8d3yJKG55NXLuQw8VUIRNre2FW0EdtqWV4jkY31fU5BaxC1nkAxdBESkiPuQ=="}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:46.623982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-be2037ce-3d7c-4d0d-ae64-2a26acb3f26f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:46.644273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-be2037ce-3d7c-4d0d-ae64-2a26acb3f26f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:46.761147 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-be2037ce-3d7c-4d0d-ae64-2a26acb3f26f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.495880 Jun 22 19:38:46.761916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 6/12] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:38:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:38:46.958887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b13c2603-e345-460c-9698-77a567a0f68f tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1a3310>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.064697 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b13c2603-e345-460c-9698-77a567a0f68f tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/10d369ca-9532-46ac-bcef-841ed33e80d2" status: 200 len: 350 microversion: 2.1 time: 0.110603 Jun 22 19:38:47.065518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 19:38:46 2022] GET /compute/v2.1/os-volumes/10d369ca-9532-46ac-bcef-841ed33e80d2 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:47.078663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1f659797-fc7d-43c6-9784-bd37d4489da4 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b9ec8b0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.237903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1f659797-fc7d-43c6-9784-bd37d4489da4 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.163292 Jun 22 19:38:47.238819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1133 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:47.252014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d2c023c8-8c44-4578-8861-d0d2de0802be tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b9f3dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.412422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d2c023c8-8c44-4578-8861-d0d2de0802be tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.164681 Jun 22 19:38:47.413000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1148 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:47.429153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a36e1a6d-ae7d-47b3-84ef-36427a745081 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1ba20a60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.608133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a36e1a6d-ae7d-47b3-84ef-36427a745081 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.187015 Jun 22 19:38:47.609029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1133 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:47.621861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-65d720b3-de73-4d7d-a0df-7e95d0b2ebea tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1a3af0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.726332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-65d720b3-de73-4d7d-a0df-7e95d0b2ebea tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108990 Jun 22 19:38:47.728234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1166 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:47.739910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22166c66-2469-4bc6-8498-4ba013f42353 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1a6700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:47.901113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22166c66-2469-4bc6-8498-4ba013f42353 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165630 Jun 22 19:38:47.901693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1169 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:47.916813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-473387ab-64c1-471b-a468-bad2131da928 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1b4790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:48.088834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-473387ab-64c1-471b-a468-bad2131da928 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.177179 Jun 22 19:38:48.096117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1154 bytes} [Wed Jun 22 19:38:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:48.101609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3eaa8e93-b4f7-4cc0-a675-e593926a0fb1 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1a6820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:48.247536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3eaa8e93-b4f7-4cc0-a675-e593926a0fb1 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150293 Jun 22 19:38:48.248629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1187 bytes} [Wed Jun 22 19:38:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:48.260479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-448d642e-dc89-474e-a23a-8a7e63381292 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] Calling method '.version_select at 0x7fdc1b1b4700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:48.443648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-448d642e-dc89-474e-a23a-8a7e63381292 tempest-VolumesTestJSON-1529568977 tempest-VolumesTestJSON-1529568977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187209 Jun 22 19:38:48.444631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1154 bytes} [Wed Jun 22 19:38:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:51.822327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-682102679", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:51.984198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] validate_networks() for [('f9bac6e6-c16d-4962-b622-645a4fe81c1a', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:38:52.066512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-450254035", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "networks": [{"uuid": "2123ec78-6695-4fe0-9ed3-2013593ae28c"}]}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:52.194075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] validate_networks() for [('2123ec78-6695-4fe0-9ed3-2013593ae28c', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:38:54.275347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:38:54.358194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:38:54.358672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:38:54.359212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:38:54.359493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:38:54.359906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:38:54.371574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:54.372031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:54.372862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:54.373296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:54.437434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:54.452720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for user fe09f44c5fac46799e0d6883004151bf and project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:54.493843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:38:54.496773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:38:54.694496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-670f77cc-9f9b-4612-9967-120a4f9eec0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.992369 Jun 22 19:38:54.695152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:38:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:38:55.335734 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5289df69-9c64-443e-a225-ce9aad7e93c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: .version_select at 0x7fdc1b138a60>, body: {"keypair": {"name": "tempest-keypair-521471856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO51fyLDFvPpukbbJMsoBDvLJLDgrtCzdeNBBMogk7FIFIha+j8DaV5HPBLd1oZmrZYQin+QKt/lks7O3zbRyFyolTmzvdx+uhZ2MECbg4OqdpUxy+DQaKfqaCKtIpgRfQ=="}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:55.370389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-5289df69-9c64-443e-a225-ce9aad7e93c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:55.387103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-5289df69-9c64-443e-a225-ce9aad7e93c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for user 1300250a083246a3a82aed557846cb89 and project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:55.439129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5289df69-9c64-443e-a225-ce9aad7e93c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.741564 Jun 22 19:38:55.444902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 12/23] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:38:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:38:55.454188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-309755413", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ef8d1f8-8ba0-448f-a40d-510d579e6402"}], "security_groups": [{"name": "tempest-securitygroup--853393132"}], "key_name": "tempest-keypair-1858010710", "user_data": "}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:55.497549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:38:55.498007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:38:55.498590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:38:55.499010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:38:55.499902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:38:55.530637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:55.533559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:55.543885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:55.544532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:55.687127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Getting quotas for project 6ec9412c5d834e34a3b7512134211191. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:55.699194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Getting quotas for user a78b437b24d242d0bbfb61f14fd4c85b and project 6ec9412c5d834e34a3b7512134211191. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:55.729024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:38:55.733022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] validate_networks() for [('0ef8d1f8-8ba0-448f-a40d-510d579e6402', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:38:55.733457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:38:55.909192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-82727108-32e4-4e5e-b363-d024c48b58a4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.946180 Jun 22 19:38:55.912891 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 12/24] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:38:55.927072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2b073111-2fcb-4371-8202-9b8e29e798d7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:55.927703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2b073111-2fcb-4371-8202-9b8e29e798d7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:38:56.265900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2b073111-2fcb-4371-8202-9b8e29e798d7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:56.325104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2b073111-2fcb-4371-8202-9b8e29e798d7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1221 microversion: 2.1 time: 0.403594 Jun 22 19:38:56.340422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:38:55 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1221 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:56.346136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1554747639", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed32d9a9-ebb9-465d-887b-d293660c0101"}], "security_groups": [{"name": "tempest-securitygroup--803531268"}], "key_name": "tempest-keypair-1394153160", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:56.778035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] validate_networks() for [('ed32d9a9-ebb9-465d-887b-d293660c0101', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:38:57.368799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:38:57.371502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:38:57.372644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:38:57.373384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:38:57.374079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:38:57.393946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:57.399508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:57.402942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:57.404999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:57.474958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for project b90964fa17494782b2a49ff54cfede88. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:57.496533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for user 20ef6f7c907b407b9d76bc814749d403 and project b90964fa17494782b2a49ff54cfede88. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:57.542127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:38:57.547653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:38:57.656845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d30c9585-c0ec-4cca-9c5d-ac93a54bfe3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.210581 Jun 22 19:38:57.663754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 13/26] 10.222.0.26 () {62 vars in 1187 bytes} [Wed Jun 22 19:38:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 19:38:57.675197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:57.675878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:38:57.722924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:57.724643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:57.730925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:57.731370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:58.204338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:58.237023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ccbced00-0117-4474-bdda-324e8e8631a9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1218 microversion: 2.1 time: 0.572263 Jun 22 19:38:58.245954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:38:57 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1218 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:58.253158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-951842459", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:38:58.385105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] validate_networks() for [('f9bac6e6-c16d-4962-b622-645a4fe81c1a', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:38:58.412570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:38:58.413158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:38:58.413899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:38:58.414791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:38:58.415437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:38:58.440731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:58.442674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:58.451533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:58.453299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:58.517538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:38:58.540877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:38:58.577146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:38:58.583824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:38:58.741817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c3648e40-76be-4707-adff-77cea369d847 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.401992 Jun 22 19:38:58.742882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 14/28] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:38:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:38:58.773782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:58.778803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:38:59.030475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:59.039746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:59.045206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:59.048063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-03dba9db-0c4f-4f41-972a-d165b4fc97b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1281 microversion: 2.20 time: 0.300981 Jun 22 19:38:59.049578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 15/29] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:38:58 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1281 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:38:59.070248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-413d96ad-a0c6-4ce2-bf57-e6dc6bef9357 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:59.071169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-413d96ad-a0c6-4ce2-bf57-e6dc6bef9357 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:38:59.297303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-413d96ad-a0c6-4ce2-bf57-e6dc6bef9357 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:59.315441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-413d96ad-a0c6-4ce2-bf57-e6dc6bef9357 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1242 microversion: 2.1 time: 0.255010 Jun 22 19:38:59.316845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 16/30] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:38:59 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:38:59.330311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:38:59.330929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:38:59.349518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:59.354377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:59.356821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:38:59.357771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:38:59.877117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:38:59.904398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-463946b0-7e18-4107-814a-a61f2c2c395a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1274 microversion: 2.1 time: 0.584835 Jun 22 19:38:59.905422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 17/31] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:38:59 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1274 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:00.076586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:00.077323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:00.100331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.101705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:00.104238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.105383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:00.370356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:00.381641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:00.387216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:00.394836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-11e31c86-4694-4fbd-8dfd-1b682360ce1b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1333 microversion: 2.20 time: 0.328983 Jun 22 19:39:00.396900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 18/32] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:00 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1333 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:00.416908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:00.418021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:00.438217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.438875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:00.439975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.441916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:00.648800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:00.662952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55a9bbc8-a928-4d02-b793-b5566e95a20e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1294 microversion: 2.1 time: 0.258609 Jun 22 19:39:00.665514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 19/33] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:00 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1294 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:00.923821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:00.925964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:00.943613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.946909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:00.951330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:00.952740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.313259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:39:01.313851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:39:01.314128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:39:01.314526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:39:01.315202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:39:01.341224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.350484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.356392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.357100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.432012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:39:01.458108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for user fe09f44c5fac46799e0d6883004151bf and project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:39:01.514837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:39:01.522938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:39:01.684773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e465a30c-046f-41dc-a0de-be666569c178 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.437467 Jun 22 19:39:01.685441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 15/34] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:38:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:39:01.720210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:01.720210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:01.737126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.737957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.751032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.751730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.893093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:01.901925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1851a508-011d-424a-a005-1b190b75b5b1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1272 microversion: 2.1 time: 0.983598 Jun 22 19:39:01.916585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 20/35] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:00 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1272 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:01.921513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:01.929188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:01.968676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.972946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:01.976410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:01.977526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:02.307307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:02.329632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-97774444-8380-4972-b7f9-67a3bf91cbc8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1300 microversion: 2.1 time: 0.397791 Jun 22 19:39:02.330287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 21/36] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:01 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1300 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:02.339302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-704a8a84-a1bd-4be9-b035-f921275027ad tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:02.339302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-704a8a84-a1bd-4be9-b035-f921275027ad tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:02.712163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-704a8a84-a1bd-4be9-b035-f921275027ad tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:02.730619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-704a8a84-a1bd-4be9-b035-f921275027ad tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1221 microversion: 2.1 time: 0.398956 Jun 22 19:39:02.733125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:02 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1221 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:02.760618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1792336845", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eca3001-1b6f-4e98-983b-840dfedc59fb"}], "security_groups": [{"name": "tempest-securitygroup--424258270"}], "key_name": "tempest-keypair-521471856", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:03.191961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:03.203442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:03.208642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:03.225564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ab61854b-ec23-40d2-958e-63814bb908ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1339 microversion: 2.20 time: 1.538636 Jun 22 19:39:03.234052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 16/38] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:01 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1339 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:03.238988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:03.239601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:03.277139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:03.277592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:03.278365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:03.278795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:03.567541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:03.570965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] validate_networks() for [('2eca3001-1b6f-4e98-983b-840dfedc59fb', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:39:03.608513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5da54107-45a7-4342-b625-69b85e4c6f44 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1272 microversion: 2.1 time: 0.369947 Jun 22 19:39:03.640679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 17/39] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:03 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:03.698382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:03.699196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:03.756436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:03.764492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:03.778760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:03.799442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:04.223737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:04.234802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0e253ab9-e170-47f1-a87f-9585931710cf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1300 microversion: 2.1 time: 0.577962 Jun 22 19:39:04.235526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 18/40] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:03 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1300 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:04.296305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:04.300298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:04.322432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:04.323115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:04.324400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:04.327433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:04.962099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:04.972644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e18b6300-bb64-406d-97d4-8f653e3e3a5b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1281 microversion: 2.1 time: 0.704648 Jun 22 19:39:04.988307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:04 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1281 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:04.995862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:05.011606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:05.024185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.024951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:05.028509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.031465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:05.200777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:39:05.202165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:39:05.203408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:39:05.204053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:39:05.204678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:39:05.231487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.233008 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:05.238303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.240059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:05.347020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:39:05.377516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for user 1300250a083246a3a82aed557846cb89 and project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:39:05.409860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:39:05.412347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:39:05.614251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dbef7e10-7852-4e27-98ef-52824d772d9b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.877251 Jun 22 19:39:05.619574 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 23/42] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:39:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:39:05.636622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:05.637340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:05.662756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.663213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:05.664022 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:05.676703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:06.134669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.145626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.150342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.169927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c40d5d4f-4a7a-4cc3-bcd8-53db48936f75 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1339 microversion: 2.20 time: 1.180385 Jun 22 19:39:06.171090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 20/43] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:04 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1339 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:06.185598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:06.186444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:06.201223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:06.201920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:06.207512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:06.211466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:06.464477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.473977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4d0a61b5-8ef9-4b37-af7f-f04d3f815ade tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1300 microversion: 2.1 time: 0.301594 Jun 22 19:39:06.474571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 21/44] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:06 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1300 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:06.492642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9d1a5fdc-5710-4517-b34a-5e549c7b3949 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:06.493599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9d1a5fdc-5710-4517-b34a-5e549c7b3949 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:06.716672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9d1a5fdc-5710-4517-b34a-5e549c7b3949 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.772513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9d1a5fdc-5710-4517-b34a-5e549c7b3949 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1237 microversion: 2.1 time: 0.289608 Jun 22 19:39:06.774780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 22/45] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1237 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:06.805355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:06.807342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:06.812493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:06.825418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d171de84-e829-4da6-9a1d-df86647ec6c9 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 1.204583 Jun 22 19:39:06.826032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 24/46] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:05 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:06.837998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:06.839802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:06.842171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:06.844996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.150982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.159869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2d9b121e-d930-4da0-8339-a12ab0f80fa6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1279 microversion: 2.1 time: 0.383821 Jun 22 19:39:07.162658 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 23/47] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:06 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:07.191898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:07.192736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:07.206664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.207121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.218079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.219014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.410471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.425020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.428474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.438636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cc00d394-35ab-4c16-875f-d267f485cc67 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1339 microversion: 2.20 time: 0.251581 Jun 22 19:39:07.444263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 25/48] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:07 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:07.491706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:07.492619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:07.499814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.500312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.501091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.501532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.743906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.754430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-593a4e6c-791b-4961-949f-e88d6f368924 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1300 microversion: 2.1 time: 0.266543 Jun 22 19:39:07.755572 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:07 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:07.792471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:07.793221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:07.802162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.802616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.805611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.806066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.845813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:07.847920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:07.857666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.858440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.860016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:07.860016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:07.978857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:07.992383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-603c50df-ca23-496a-8cd2-82d1b80088a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.204766 Jun 22 19:39:07.996448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:08.185149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:08.185950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:08.197582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.198735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.201131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.201810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.295154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:08.320882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58a3ae04-f4c1-4a33-9b4d-48383eb5d42c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1279 microversion: 2.1 time: 0.140167 Jun 22 19:39:08.322833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:08 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:08.538224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-527bb93b-0617-457f-8ac4-a218adb55f2f req-c5390482-3307-4173-ba39-d28538c6f783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef8e89-7e43-4a42-b7da-687e608695c5", "tag": "e41583d4-5f52-4552-b13a-7d8961e18154"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:08.546165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:08.551561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-527bb93b-0617-457f-8ac4-a218adb55f2f req-c5390482-3307-4173-ba39-d28538c6f783 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.552088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-527bb93b-0617-457f-8ac4-a218adb55f2f req-c5390482-3307-4173-ba39-d28538c6f783 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.573915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-527bb93b-0617-457f-8ac4-a218adb55f2f req-c5390482-3307-4173-ba39-d28538c6f783 service nova] Creating event network-changed:e41583d4-5f52-4552-b13a-7d8961e18154 for instance 4bef8e89-7e43-4a42-b7da-687e608695c5 on hv-cinder-84721 Jun 22 19:39:08.574691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-527bb93b-0617-457f-8ac4-a218adb55f2f req-c5390482-3307-4173-ba39-d28538c6f783 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 19:39:08.575968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.576424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.577356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.577986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.589157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.compute.rpcapi [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 19:39:08.590216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] Releasing lock "compute-rpcapi-router" {{(pid=124857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 19:39:08.607059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5b0b28d2-1fec-4402-a522-9fab2bf86051 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163942 Jun 22 19:39:08.613007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 28/52] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:39:08.627088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:08.627787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:08.634325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.634980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.637145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.637837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.904072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:08.921366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:08.923043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:08.924208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dd67e18d-832d-475f-a8bd-08519a9fb907 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.309881 Jun 22 19:39:08.928880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 29/53] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:08 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:08.939983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:08.940885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:08.947817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.948317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:08.952562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:08.953025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.220651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:09.234512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-849fe889-3be2-4328-b95f-e466bd0011dd tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.304438 Jun 22 19:39:09.235729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 30/54] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:08 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:09.236541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:09.249252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:09.252462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b7cd700e-95e5-4540-9307-11fad7b9f824 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 1.412647 Jun 22 19:39:09.253059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 25/55] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:07 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:09.254133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:09.270993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.272174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.273857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.274854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.338873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:09.339406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:09.342492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:09.350848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.351819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.353189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.356374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.430940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:09.447702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2e0887f9-10ea-4fbf-9b43-585b8b123775 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.209565 Jun 22 19:39:09.449906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 31/56] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:09.487660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:09.507376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3e698da9-058c-458b-8991-aa8ec1f9a817 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1279 microversion: 2.1 time: 0.170673 Jun 22 19:39:09.508661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 26/57] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:09 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:09.942984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:09.943815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:09.955124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.956232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:09.957256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:09.958126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.155222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-e5a8a8b0-8792-4079-b047-edd6af8a699c req-00c65b91-568c-4700-9d1b-8622e3ea130a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebc14a2-64d9-4c3a-b545-f37268103753", "tag": "dc7075a1-3532-4915-adf8-c209858b35ef"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:10.177833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-e5a8a8b0-8792-4079-b047-edd6af8a699c req-00c65b91-568c-4700-9d1b-8622e3ea130a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.179201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-e5a8a8b0-8792-4079-b047-edd6af8a699c req-00c65b91-568c-4700-9d1b-8622e3ea130a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.226083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.238592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.242077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.244143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5e5ebd8e-eb9e-42de-b86c-3639336718bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.305569 Jun 22 19:39:10.244710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 32/58] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:09 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:10.245305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-e5a8a8b0-8792-4079-b047-edd6af8a699c req-00c65b91-568c-4700-9d1b-8622e3ea130a service nova] Creating event network-changed:dc7075a1-3532-4915-adf8-c209858b35ef for instance 9ebc14a2-64d9-4c3a-b545-f37268103753 on hv-cinder-84721 Jun 22 19:39:10.247878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-e5a8a8b0-8792-4079-b047-edd6af8a699c req-00c65b91-568c-4700-9d1b-8622e3ea130a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 19:39:10.247878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.247878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.252290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.252946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.259396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:10.260225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:10.269030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.269679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.270638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.271214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.279463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.compute.rpcapi [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 19:39:10.281002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-592a5825-86be-43de-995f-e2d249ab709b None None] Releasing lock "compute-rpcapi-router" {{(pid=124856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 19:39:10.316582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-592a5825-86be-43de-995f-e2d249ab709b None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266016 Jun 22 19:39:10.317465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 27/59] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:39:10.322818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:10.323720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:10.330450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.331281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.332606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.333249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.448522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.457273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a18ada69-68c5-4a6e-9d2f-c62f0067b344 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.208091 Jun 22 19:39:10.458281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 33/60] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:10 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:10.479753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:10.480487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:10.486637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.487152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.487932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.488392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.528998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.539610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5f228979-096c-4b6e-b120-06ea3220c87f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.220912 Jun 22 19:39:10.544842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 28/61] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:10 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:10.551545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:10.552443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:10.560547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.561234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.562402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:10.563158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:10.599186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.604230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:10.615109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1fe5330f-9c12-4ebd-b0cc-f1e17546e7d2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.150610 Jun 22 19:39:10.625943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 34/62] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:10.732920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:10.742879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90f4b0a9-e756-4d5e-a566-57939bc8f2bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.196550 Jun 22 19:39:10.747803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 29/63] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:10 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:11.262861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:11.263686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:11.270876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.271672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.272731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.273371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.441822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.451728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.453294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.454452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ce640d2-485b-44af-9767-ca6c589a911c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.196570 Jun 22 19:39:11.455024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 35/64] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:11 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:11.474958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:11.475663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:11.482008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.482547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.483319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.483750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.558972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:11.560035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:11.571500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.572296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.573124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.573735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.676909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.685579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-426eff67-691d-4858-8bb7-cfe20c0343a6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.214508 Jun 22 19:39:11.694654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 30/65] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:11 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:11.706961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:11.709847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:11.722972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.723419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.724275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.724701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.747904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.758813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f5eb8eed-6727-4e96-916a-f7642404ef29 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.205440 Jun 22 19:39:11.759675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 36/66] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:11 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:11.765303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:11.766232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:11.773565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.774447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.775433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:11.776197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:11.816889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.823120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:11.825905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-77893be8-9b5f-4571-a0f6-87c120511f85 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.138142 Jun 22 19:39:11.826532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 31/67] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:11.931463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:11.939341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-42ac024d-5e2d-41cd-a799-c62e99710469 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.178209 Jun 22 19:39:11.939930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 37/68] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:11 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:12.473071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:12.474569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:12.482385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.483127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.483830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.484500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.703359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:12.704825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:12.708779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:12.714711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.717369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.718051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:12.718176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.718615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.719558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:12.720700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85093da9-89fa-43fb-b575-4b9b60d62a95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.252671 Jun 22 19:39:12.728446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 32/69] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:12 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:12.775329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:12.775939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:12.785621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.786014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.786781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:12.787208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:12.979397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:12.988556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-153099cc-6613-47ac-ab72-69cdc9217c8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.289695 Jun 22 19:39:12.998473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 38/70] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:12 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:13.004904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:13.005517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:13.025326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.026198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.027673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.028500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.128851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.139154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bf5026cf-8776-46d7-8429-1a20dcdc0748 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.138231 Jun 22 19:39:13.140152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 39/71] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:13.148485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:13.149297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:13.158915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.159789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.168616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.169502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.177408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.177883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1e066c81-3093-463d-8f02-72091e0b5001 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.398495 Jun 22 19:39:13.177883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 33/72] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:12 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:13.314151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.321558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-287b7fcb-d689-4d82-b88e-15b4eb239d3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.180074 Jun 22 19:39:13.322319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 40/73] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:13 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:13.743413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:13.744136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:13.750838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.751550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.752570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:13.753196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:13.921369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.930014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.931526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:13.932849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6230b08a-5f36-4783-8501-bd0d1e90b3e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.193841 Jun 22 19:39:13.933421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 34/74] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:13 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:14.006474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:14.007206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:14.014058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.014567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.015405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.015836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.159188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:14.159969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:14.175198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.175741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.176802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.177506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.189255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:14.197588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0d00bf1-a500-4393-96de-94db4ccafad5 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.195232 Jun 22 19:39:14.203098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 41/75] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:14 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:14.213436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:14.214066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:14.221268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.221965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.223197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.223778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.275533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:14.283818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5c9dc2a5-e793-4945-8a3b-bc13778534e9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.130607 Jun 22 19:39:14.293965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 35/76] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:14.337924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:14.338752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:14.345016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.345556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.346346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.346775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.415426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:14.426899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-38c83fae-0c74-4c56-9dab-09aa6cae4903 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.222503 Jun 22 19:39:14.427710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 42/77] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:14 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:14.532231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:14.541267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-df669789-d069-4c7c-92e6-f49bc8e7131d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.206828 Jun 22 19:39:14.542349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 36/78] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:14 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:14.951418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:14.952041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:14.958528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.958995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:14.959763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:14.960315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.092464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.100522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.102350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.103448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ac725445-1511-4505-b6cb-b46963224a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.155962 Jun 22 19:39:15.104006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 43/79] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:14 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:15.214394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:15.215075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:15.221689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.222424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.223231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.223654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.301227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:15.301867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:15.312096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.312560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.316580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.317031 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.380487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.387418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=26 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:15.390660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-970c05e7-e057-4ff5-80cb-43bb72fc3ee3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.180065 Jun 22 19:39:15.391562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 37/80] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:15 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:15.397214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.409807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2cb78523-347b-47db-ae45-953d98a08a4f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.112345 Jun 22 19:39:15.410405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 44/81] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:15.449874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:15.449874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:15.450934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.451881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.452152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.452568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.559456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:15.560054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:15.566983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.572781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.572781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:15.572781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:15.631381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.641045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-86efde51-206f-4b9d-953f-c74882d2be0a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.200730 Jun 22 19:39:15.642481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 38/82] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:15 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:15.778134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:15.786768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d96f2617-785b-4e70-8f64-41e309559458 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.231746 Jun 22 19:39:15.787321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 45/83] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:15 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:16.122476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:16.123600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:16.131075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.131954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.133297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.134121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.267406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.278150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.280492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.282185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cdb8d878-fd6b-4aa1-9f1f-7eca480d50df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.164213 Jun 22 19:39:16.282833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 39/84] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:16 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:16.407908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:16.408521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:16.415063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.415475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.416260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.416689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.429927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:16.431364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:16.438916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.439652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.440704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.441306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.515857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.523384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c0e7e101-7c92-4ef8-904b-384ad27bdda0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.097712 Jun 22 19:39:16.523956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:16.563191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.570847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-920bafd6-614f-49a3-886c-cea6034d85f8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.166810 Jun 22 19:39:16.571424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 46/86] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:16 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:16.658685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:16.659312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:16.665735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.666188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.666951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.667384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.747050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=28 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:16.803593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.804014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:16.804651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:16.810677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.811087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.811639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a97f5da3-c166-4350-a630-99bb0e574cf1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.156853 Jun 22 19:39:16.812043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:16.812365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:16 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:16.812488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:16.957471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:16.968962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d13f2363-7c3c-4f90-a009-0cb08ce43396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.168648 Jun 22 19:39:16.969770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 47/88] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:16 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:17.300460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:17.301203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:17.307630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.308076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.308882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.309416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.454722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.463107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.464921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.466254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8072c974-bd81-4e76-a3a7-389f08db8759 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.170033 Jun 22 19:39:17.466976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 42/89] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:17 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:17.540718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:17.541394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:17.547717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.548156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.548947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.549378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.588665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:17.589517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:17.596727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.597347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.598193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.598693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.611118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.618619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c64787eb-ac4d-480d-9352-cbd3c6d6ce1f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1241 microversion: 2.1 time: 0.081824 Jun 22 19:39:17.619194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 48/90] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:17.732140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.740070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6ac24ac8-d4fd-4ed9-bfd7-32db2696ea79 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.155488 Jun 22 19:39:17.740687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:17 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:17.828216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:17.828831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:17.835360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.835811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.836611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.837046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.971565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:17.979852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5bc0a4b4-191e-4f1a-a3b3-7ef08efd6e2f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.155606 Jun 22 19:39:17.980505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 49/92] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:17 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:17.986936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:17.987638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:17.993758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.994202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:17.994950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:17.995371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.138774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:18.148299 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0ae0648c-ac0f-491e-b57d-28204a09bd3a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.165241 Jun 22 19:39:18.148915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:17 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:18.484432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:18.485044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:18.491375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.491820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.492583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.493053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.585562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=8 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:18.633320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:18.635025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:18.635640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:18.642497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:18.643716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.643716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.643910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.644299 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.645839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:18.647536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9e27389b-3855-40b9-a509-757137bd31f2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.167102 Jun 22 19:39:18.649886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 50/94] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:18 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:18.757457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:18.758462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:18.765241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.765695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.766538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:18.767142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:18.790349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:18.815270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:18.827166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2c637e48-a79f-4123-8e97-909c99024c17 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1233 microversion: 2.1 time: 0.195974 Jun 22 19:39:18.829947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1233 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:18.996900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:18.997558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:19.004391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.004837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.005800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.006408 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.095083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.105384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ebfff43d-77a4-4de0-a480-005b97f924ec tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.351894 Jun 22 19:39:19.106650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:18 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:19.165694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:19.166387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:19.172807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.173319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.174983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.175501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.439787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.450870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ccf1cd96-4b4b-450e-9dd2-48eb86482b2d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.289141 Jun 22 19:39:19.456640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 52/97] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:19 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:19.622705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.638592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9cb42e9d-4087-407c-a448-4b5467d854bc tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.645239 Jun 22 19:39:19.640466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 46/98] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:18 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:19.668165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:19.670138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:19.678887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.679585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.680682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.681291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.850249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:19.851322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:19.861270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.862072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.863866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:19.865025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:19.957548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.967090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.968734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:19.969950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3e7079ab-8a2b-4de3-9b6f-dd351f630fd1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.305830 Jun 22 19:39:19.970585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 53/99] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:19 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:20.128218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:20.130443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:20.136811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.137264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.138093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.138531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.138676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:20.150922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7890a056-ffeb-4439-8eee-e1a002fdb804 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1295 microversion: 2.1 time: 0.306369 Jun 22 19:39:20.153208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 47/100] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1295 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:20.283580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:20.292092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6b54c7fd-2af4-4de0-adcb-b1d09f981f4d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.168060 Jun 22 19:39:20.292782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 54/101] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:20 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:20.475385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:20.476012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:20.478646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=8 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:20.490708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.491522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.492656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.493551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.519557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:20.658465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:20.660296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:20.671178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.671773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.672439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.672872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.837150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:20.845715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-483acc0e-963e-4e11-a8d2-e7ee6046ab49 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.191979 Jun 22 19:39:20.846288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 55/102] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:20 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:20.988884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:20.989488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:20.996777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.997248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:20.998016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:20.998451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.144894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.153782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.155561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.156747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13f5413b-83af-4416-852f-d476457fcdd0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.171960 Jun 22 19:39:21.158166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 56/103] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:20 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:21.172992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:21.174122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:21.188324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.189081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.189964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.190510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.237052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.247144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8c76476a-f946-405d-b153-aa464081ba5c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.776189 Jun 22 19:39:21.248001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 48/104] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:20 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:21.279717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.293904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4ac733e1-ea8c-4a33-850b-350cc58a5642 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1295 microversion: 2.1 time: 0.128418 Jun 22 19:39:21.294493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 57/105] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:21.312072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:21.312874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:21.319470 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.320405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.321785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.322730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.568051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-22f1a0f2-252d-4674-81e4-6902e6c748a2 req-f60ef36d-4b4f-4790-8188-ca978e06c84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60784b8-22f8-4043-9656-c629245206da", "tag": "c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:21.586203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-22f1a0f2-252d-4674-81e4-6902e6c748a2 req-f60ef36d-4b4f-4790-8188-ca978e06c84f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.589445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-22f1a0f2-252d-4674-81e4-6902e6c748a2 req-f60ef36d-4b4f-4790-8188-ca978e06c84f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.612476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-22f1a0f2-252d-4674-81e4-6902e6c748a2 req-f60ef36d-4b4f-4790-8188-ca978e06c84f service nova] Creating event network-changed:c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f for instance e60784b8-22f8-4043-9656-c629245206da on hv-cinder-84721 Jun 22 19:39:21.623095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-22f1a0f2-252d-4674-81e4-6902e6c748a2 req-f60ef36d-4b4f-4790-8188-ca978e06c84f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060032 Jun 22 19:39:21.623095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 58/106] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:39:21.735223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:21.747661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8322418a-a1bd-4d8a-b1ae-124cf5483989 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.440604 Jun 22 19:39:21.748546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 49/107] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:21 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:21.867299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:21.868156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:21.875117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.875749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:21.877326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:21.877953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.023661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.031959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6e588820-cd69-4482-824f-aeb3523dad98 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.169853 Jun 22 19:39:22.032994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 59/108] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:21 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:22.175077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:22.175764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:22.182013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.182459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.183204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.183630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.264533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:22.265241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:22.271652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.272456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.274025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.274617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.330762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.338821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.340362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.341471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-831fb191-e0e5-4433-946b-fbc2c305e460 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.170442 Jun 22 19:39:22.342025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 50/109] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:22 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:22.346818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:22.347649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:22.354108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.354729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.356383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.356954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.425533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.426806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.433277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d6fc7178-af38-40d5-91e0-1b129a1f9125 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1295 microversion: 2.1 time: 0.090144 Jun 22 19:39:22.433930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 51/110] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:22.435053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fa69daf0-9679-437a-93a1-b34e4c2804b4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.174360 Jun 22 19:39:22.435912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 60/111] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:22 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:22.766116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:22.766694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:22.772994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.773434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.774313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:22.774745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:22.921683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:22.929511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-68965909-69cd-40a8-a10c-e2ad64a50621 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.167511 Jun 22 19:39:22.930418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 52/112] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:22 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:23.053123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:23.053957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:23.064254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.065012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.066088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.066519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.211608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.219693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4485b8ef-9468-4bc7-b60b-7cf85fc94e73 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.173385 Jun 22 19:39:23.220296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 61/113] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:23 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:23.363302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:23.364160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:23.374399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.375162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.376478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.377222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.450515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:23.451152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:23.457688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.458205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.458984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.459424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.560420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.575838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a7f837f3-b325-4d65-9ba8-58014aa0704a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1295 microversion: 2.1 time: 0.129335 Jun 22 19:39:23.579397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.588130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 62/114] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:23.591506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.593200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.593627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:23.594238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:23.594371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10b265c6-3785-4fe9-af3f-bc949cf6a510 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.237942 Jun 22 19:39:23.594931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 53/115] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:23 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:23.601382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.601865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.603053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.603649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.655131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}, {"name": "network-changed", "server_uuid": "4083c205-6284-4602-ac2f-c515a2c55045", "tag": "8ba90739-57c2-4418-bf14-93314c9639a7"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:23.669701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.670334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.685310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] Creating event network-changed:6a6fc786-b0fd-4333-a1bb-cbc2584be0e0 for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 on hv-cinder-84721 Jun 22 19:39:23.685898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] Creating event network-changed:8ba90739-57c2-4418-bf14-93314c9639a7 for instance 4083c205-6284-4602-ac2f-c515a2c55045 on hv-cinder-84721 Jun 22 19:39:23.693792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-4858a73a-9e0a-4140-ac64-dae2d474271f req-d9d8c148-bd8c-46b4-86ef-28359f39a244 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044973 Jun 22 19:39:23.695076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 54/116] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:23.827224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:23.835917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af2ce02f-a236-4382-8d83-dcd8d86f1188 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.246081 Jun 22 19:39:23.836763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 63/117] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:23 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:23.952733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:23.954133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:23.974203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.974888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:23.975737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:23.976197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.237894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:24.238684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:24.245254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.245702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.246483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.246915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.391849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.400528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-74ffaf1b-c043-4ba8-96b3-25393d75d607 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.167283 Jun 22 19:39:24.401294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 64/118] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:24 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:24.417192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.425641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-578d1ad9-e4d7-4607-a2fd-e7e1e7562c1b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.480122 Jun 22 19:39:24.426274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 55/119] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:23 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:24.594988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:24.595677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:24.602367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.602812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.603764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.604192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.615291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:24.615979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:24.623305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.624042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.625085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.625686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.781141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.792200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-864ad811-a64d-48c7-bbff-52478250726c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.201194 Jun 22 19:39:24.794072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 65/120] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:24.851784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.853764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:24.854577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:24.861725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.861894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.863429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:24.864733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f162dfb5-75d0-4a12-821a-9cc2111f236e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.255644 Jun 22 19:39:24.864964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:24.865286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 56/121] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:24 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:24.866294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:24.867450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.025393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:25.035517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5910c181-9722-4879-92f8-ec67674b27cd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.186371 Jun 22 19:39:25.037047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 66/122] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:24 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:25.418195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:25.418803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:25.424993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.425433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.426180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.426600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.442686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:25.443285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:25.449423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.449870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.450627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.451059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.565694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:25.574095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f02b56b2-c241-440d-a06c-bdb9ff7d170e tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.159670 Jun 22 19:39:25.574639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 57/123] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:25 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:25.586453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:25.594268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7c13fc8a-1553-4d24-84ab-5c8dcef391ab tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.155510 Jun 22 19:39:25.594831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 67/124] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:25 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:25.810083 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:25.810594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:25.817277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.817744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.818486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.818916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.882228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:25.882864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:25.889066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.889515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.890269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:25.890693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:25.955814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:25.963597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9543b89d-13fc-4f7a-b785-ba55f915741d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.157486 Jun 22 19:39:25.970422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 58/125] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:26.021234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.024855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:26.030159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.031652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.032776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2ffbf813-0802-4012-8a1a-2dea8581b4e8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.154531 Jun 22 19:39:26.033566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 68/126] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:25 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:26.053177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:26.053784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:26.060590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.060972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.061722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.062153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.198645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.210597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-576fa5ba-6c62-4177-b21d-c102f512dfae tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.161048 Jun 22 19:39:26.211365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 59/127] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:26 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:26.592768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:26.593327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:26.599784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.600270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.601039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.601554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.610912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:26.611679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:26.618691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.619342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.620482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.621349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:26.765616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.775705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ef2e1d0f-594f-4575-9498-442f3890df76 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.187174 Jun 22 19:39:26.776585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 69/128] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:26 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:26.798459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:26.806194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b432619b-0964-472a-88d2-2e7b295ef407 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.199132 Jun 22 19:39:26.806755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 60/129] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:26 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:26.991041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:26.991677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:26.998801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:26.999294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.000139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.000632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.051324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:27.051944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:27.058639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.059089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.059844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.060304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.145493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:27.152967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-35557bce-bcb4-409a-8b46-aa267b0158a5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.168527 Jun 22 19:39:27.153538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 70/130] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:27.228604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:27.229208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:27.235471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.235914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.236704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.237262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.401013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:27.409105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5e6a6223-9d5b-4cf6-a751-9f3335c88898 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.184638 Jun 22 19:39:27.409688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 71/131] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:27 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:27.794741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:27.796381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:27.804482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.805265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.806573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:27.807409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:27.951005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:27.960664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:27.962152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:27.968937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7a768919-b47f-4eb5-8ee8-cd06d78cc77b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.917504 Jun 22 19:39:27.969608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 61/132] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:27 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:28.001689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:28.002304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:28.033681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.034186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.035011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.035468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.067351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:28.081525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-99ea7cf4-a8ec-438c-be62-ade33c9e63fe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.292499 Jun 22 19:39:28.083404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 72/133] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:27 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:28.170528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:28.171744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:28.180335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.181159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.182526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.183123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.413506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:28.422306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6428119d-c186-47ba-afd8-458792b9de2c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.255723 Jun 22 19:39:28.432494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 73/134] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:28.438411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:28.439289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:28.453471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.454113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.455071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.456357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.657849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:28.666104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55bfcf0a-6d82-4478-87f3-ac03f4e13bec tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.232248 Jun 22 19:39:28.667230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:28 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:28.682875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:28.696210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-040a9444-4027-4ad4-a60e-c88971ceef66 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.725486 Jun 22 19:39:28.698089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 62/136] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:27 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:28.988662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:28.990048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:28.997299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:28.997913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:28.998686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.004546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.101100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:29.103300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:29.118105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.119715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.120681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.121366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.220379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.230598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.232866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.234473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-97ff68b7-2324-4426-b319-edaf7a5afd83 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.251604 Jun 22 19:39:29.245437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 75/137] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:28 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:29.255698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-4dba34a3-cd45-4e72-9183-02b8ec2782e5 req-22d995ac-4b6f-45c9-a7f1-eb983b7ae923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498198b2-0179-45ba-8753-15a2d61e7018", "tag": "122a26bf-0569-4fc7-a032-d4665ea55d7d"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:29.266513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-4dba34a3-cd45-4e72-9183-02b8ec2782e5 req-22d995ac-4b6f-45c9-a7f1-eb983b7ae923 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.267688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-4dba34a3-cd45-4e72-9183-02b8ec2782e5 req-22d995ac-4b6f-45c9-a7f1-eb983b7ae923 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.279838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-4dba34a3-cd45-4e72-9183-02b8ec2782e5 req-22d995ac-4b6f-45c9-a7f1-eb983b7ae923 service nova] Creating event network-changed:122a26bf-0569-4fc7-a032-d4665ea55d7d for instance 498198b2-0179-45ba-8753-15a2d61e7018 on hv-cinder-84721 Jun 22 19:39:29.287712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-4dba34a3-cd45-4e72-9183-02b8ec2782e5 req-22d995ac-4b6f-45c9-a7f1-eb983b7ae923 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037459 Jun 22 19:39:29.288882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 76/138] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:29.323995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.348048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d419b02f-40ca-42ff-a4cb-9f2d7fe430d4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.252894 Jun 22 19:39:29.349136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 63/139] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:29 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:29.439247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:29.439932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:29.446082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.446534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.447268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.447688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.599650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.608480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5d0ee134-d24c-47ab-ac72-4a5a06653ebd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.173327 Jun 22 19:39:29.609060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 77/140] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:29.682503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:29.683108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:29.689275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.689721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.690542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.690990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.718065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:29.719049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:29.722290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:29.726136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.726747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.727918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:29.728419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:29.850625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.858552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-419810f8-1ba3-4f6d-9896-8a7c0d092f82 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.179777 Jun 22 19:39:29.859315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 64/141] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:29 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:29.865337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:29.873001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61b6d793-7af2-4b03-8ea0-d7647ae814bb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.163243 Jun 22 19:39:29.873566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 78/142] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:29 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:30.255055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:30.255644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:30.262088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.262924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.263389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.263727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.365814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:30.367056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:30.372595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.373255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.374013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.375043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.399706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:30.403784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:30.410707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:30.412636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:30.413792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-19a9c010-b5da-4b6a-a5f8-f4472522fe0d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.162630 Jun 22 19:39:30.414479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 65/143] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:30 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:30.511484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:30.519432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e8ce6096-74b5-499b-ad8c-21b58def68c5 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.158207 Jun 22 19:39:30.520044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 79/144] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:30 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:30.625811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:30.626487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:30.635162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.635603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.636412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.636843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.773465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:30.780996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c37a90c7-2cf7-4e4d-ad39-0f14c63ada6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.159598 Jun 22 19:39:30.781577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 66/145] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:30.875717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:30.876439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:30.882701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.883187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.885098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.885098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.889749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:30.890353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:30.896837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.897371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:30.898127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:30.898535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.035563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.043095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55639115-bd24-49d0-9160-8f89cfc0785f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.171384 Jun 22 19:39:31.043791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 80/146] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:30 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:31.254499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.262219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-497dfa14-f3db-4ea3-beaa-39a8908f54d9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.376140 Jun 22 19:39:31.262813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 67/147] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:30 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:31.431064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:31.432357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:31.438530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.438974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.439721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.440238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.540651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:31.540651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:31.544920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.545455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.546307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.547133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.586200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.594489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.596266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.598288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-049d7d72-a3cd-489e-9e70-0f19ce001169 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.170557 Jun 22 19:39:31.600853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 81/148] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:31 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:31.699911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:31.707359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-451e961b-b08d-4281-95b9-51f8528bf478 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.174278 Jun 22 19:39:31.707929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 68/149] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:31 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:31.798469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:31.799210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:31.805771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.806280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.807136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:31.807774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:31.992374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.001638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-64267520-1b62-493d-855b-5cfd8a735fa2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.207543 Jun 22 19:39:32.002261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 82/150] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:32.065892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:32.066503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:32.072922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.073365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.074130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.074555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.214777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.223157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b3a93546-a29d-44a3-b21f-e725c2410776 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.166216 Jun 22 19:39:32.224077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 69/151] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:32 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:32.278596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:32.279551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:32.287121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.287595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.288562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.289189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.425654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.438656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9ca0ce3e-cea6-468d-80f2-68e61e489526 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.163724 Jun 22 19:39:32.439716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 83/152] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:32 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:32.619042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:32.619719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:32.625860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.626307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.627066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.627504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.726259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:32.727788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:32.734102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.734540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.735515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:32.736118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:32.770301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.778997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.780786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.782033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aaefbbf2-7221-497b-8348-3705c0ac2fb8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.167130 Jun 22 19:39:32.782754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 70/153] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:32 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:32.880847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:32.888357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d637f318-632c-420d-bc9c-b7d974fe5654 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.167373 Jun 22 19:39:32.889084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 84/154] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:32 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:33.025190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:33.025779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:33.033545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.034041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.034769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.035222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.167382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.175113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e471d261-4d46-4024-882c-e0fe8cae608e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.153763 Jun 22 19:39:33.175698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 71/155] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:33 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:33.240825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:33.241427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:33.247272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.247705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.248453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.248892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.381498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.390232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f4b30934-d996-4298-99c1-7ca973092c91 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.153239 Jun 22 19:39:33.390893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 85/156] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:33 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:33.454719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:33.455235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:33.461328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.461766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.462526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.462980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.601525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.610170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-57e12f5f-f6c6-48e7-821d-96391373aff0 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.159325 Jun 22 19:39:33.611381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 72/157] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:33 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:33.799800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:33.800470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:33.806625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.807121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.807959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.808404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.812372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:33.905706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:33.906318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:33.913062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.913510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.914530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:33.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:33.945133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.958113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.960306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:33.961878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f2eb7e12-f71a-4c56-ba4b-609c7a03b7e4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.166290 Jun 22 19:39:33.962726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 86/158] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:33 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:34.051352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:34.058809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fec95a44-a864-4401-8221-eaa98329cbd7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.157407 Jun 22 19:39:34.059334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 73/159] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:33 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:34.192386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:34.194014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:34.200006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.200495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.201508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.201947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.335842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:34.343665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d3cff9b2-e5fe-400b-8437-3a87cbad122d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.155571 Jun 22 19:39:34.344507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 87/160] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:34.407350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:34.407955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:34.415741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.416285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.417067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.417496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.575166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:34.582878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-707fb066-cddf-4aa5-b680-c26554560faa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.179501 Jun 22 19:39:34.583537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 74/161] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:34 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:34.628636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:34.629413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:34.635897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.636372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.637138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.637569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.769991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:34.777772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-474f3c5c-7705-4829-ab9c-d2038ff48a76 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.153379 Jun 22 19:39:34.778317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 88/162] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:34 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:34.981130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:34.981718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:34.991757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.992240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:34.993009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:34.993428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.074985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:35.075517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:35.083655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.084303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.085373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.085822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.135955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.144120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.145628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.146737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3517365e-c2e7-4195-933e-837f4a84abb6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.169974 Jun 22 19:39:35.147305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 75/163] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:34 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:35.220603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.228700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-41e5ac33-ac74-4f20-a0c5-30d294373a1f tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.157745 Jun 22 19:39:35.229271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 89/164] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:35 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:35.362339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:35.363068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:35.365883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:35.369620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.370014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.370766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.371187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.508971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.519060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b060744c-3d9b-401d-acb5-41191db3cbbe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.159793 Jun 22 19:39:35.519674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 76/165] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:35.600792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:35.601461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:35.608077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.608592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.609472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.609933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.753743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:35.765769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4179d4c4-217e-401a-ba4a-61d5319d1e7f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.169166 Jun 22 19:39:35.766468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 90/166] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:35 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:35.794696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:35.795469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:35.804390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.805093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.806061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:35.806817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:35.995142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.006048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-15baf663-0add-4616-9b2d-b08c871531c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.215556 Jun 22 19:39:36.007619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 77/167] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:35 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:36.157843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-c696a6a9-947b-4d15-84a2-b526fab4de7e req-c2edd2b1-3ff9-4267-a816-be68d07df6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebc14a2-64d9-4c3a-b545-f37268103753", "name": "network-vif-plugged", "status": "completed", "tag": "dc7075a1-3532-4915-adf8-c209858b35ef"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:36.164261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:36.164869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:36.166666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c696a6a9-947b-4d15-84a2-b526fab4de7e req-c2edd2b1-3ff9-4267-a816-be68d07df6d4 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.167110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c696a6a9-947b-4d15-84a2-b526fab4de7e req-c2edd2b1-3ff9-4267-a816-be68d07df6d4 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.171282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.171730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.172541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.172957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.178237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-c696a6a9-947b-4d15-84a2-b526fab4de7e req-c2edd2b1-3ff9-4267-a816-be68d07df6d4 service nova] Creating event network-vif-plugged:dc7075a1-3532-4915-adf8-c209858b35ef for instance 9ebc14a2-64d9-4c3a-b545-f37268103753 on hv-cinder-84721 Jun 22 19:39:36.183256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-c696a6a9-947b-4d15-84a2-b526fab4de7e req-c2edd2b1-3ff9-4267-a816-be68d07df6d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094248 Jun 22 19:39:36.183867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 91/168] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:36.246138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:36.247017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:36.253652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.254092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.254851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.255279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.316128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.324143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.325632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.326742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ca2fb044-2639-474b-9f22-0ee70583381f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.166435 Jun 22 19:39:36.327323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 78/169] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:36 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:36.390674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.398484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f585c9d5-53c4-4ccb-8142-83ff2510d453 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.156623 Jun 22 19:39:36.399028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 92/170] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:36 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:36.538320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:36.539051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:36.546649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.547150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.548027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.548497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.683009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.690707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24cd2378-e59f-4c22-955e-792a43b5499a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.158697 Jun 22 19:39:36.691261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 79/171] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:36.782892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:36.783487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:36.790206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.790712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.791397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:36.791819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:36.925223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:36.937720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-20cb27ed-4af1-420f-ba13-722d03434af4 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.158665 Jun 22 19:39:36.938300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 93/172] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:36 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:37.024937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:37.025761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:37.032127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.032649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.033479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.034011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.166800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.174783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-955e2051-c2bf-4660-b049-ac16a6d47398 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.153953 Jun 22 19:39:37.175360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 80/173] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:37 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:37.344964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:37.345683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:37.356147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.356797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.357878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.358499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.415512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:37.416063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:37.422241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.422675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.423410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.423814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.491251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.499522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.501054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.502162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c548ccdb-3688-4471-9e6f-fe23a653bbe0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.161726 Jun 22 19:39:37.502740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 94/174] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:37 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:37.554195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.562040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2544b1cf-d626-4922-8a0a-cdb21763d2b3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.150706 Jun 22 19:39:37.562592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 81/175] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:37 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:37.711253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:37.711865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:37.718643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.719161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.720162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.720796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.859823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:37.867604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c6264c21-0771-4761-a05a-c9de37692e6b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.160319 Jun 22 19:39:37.868163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 95/176] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:37.955046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:37.955758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:37.962164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.962583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.963334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:37.963734 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:37.982510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:38.104825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.112687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-36c2c7b5-f62f-4767-9b30-9cde2bcb80fc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.161615 Jun 22 19:39:38.113263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 82/177] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:37 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:38.191144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:38.191785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:38.198003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.198449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.199218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.199652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.360922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.371257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fa2389e0-b779-4e0e-8f98-b4d6459628c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.183773 Jun 22 19:39:38.372406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 96/178] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:38 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:38.523374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:38.523986 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:38.532660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.533407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.534336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.534767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.579500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:38.580755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:38.587511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.588300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.589266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.590024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.707892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.723445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.726665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.729474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-43c95391-bb7c-41fe-b70b-3dc665942d21 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.213136 Jun 22 19:39:38.730335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 83/179] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:38 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:38.783335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:38.797843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5083d1c4-a824-4d42-b408-0d7142cd17d0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.218053 Jun 22 19:39:38.797843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 97/180] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:38 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:38.885558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:38.886301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:38.914973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.915419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:38.916269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:38.916710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.130984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:39.131591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:39.131694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:39.138550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.139258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.140030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d986c098-b80b-406c-8422-49eef76905a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.258870 Jun 22 19:39:39.140627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.140753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 84/181] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:39.141332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.334066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:39.341939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cf3e18cf-c258-4690-9b14-ce9197f8eaf1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.215673 Jun 22 19:39:39.342515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 98/182] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:39 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:39.399213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:39.399814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:39.406957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.407400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.408289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.408891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.553531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:39.563703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-099ae6fa-870c-48d2-868d-1e6bf9281334 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.168566 Jun 22 19:39:39.564726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 85/183] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:39 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:39.748029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:39.748667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:39.755587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.756319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.757261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.757920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.817053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:39.818018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:39.827064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.827892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.829032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:39.829703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:39.988562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:39.997545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bb7a1670-f646-4c7c-9799-412db040bf24 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.188421 Jun 22 19:39:39.998505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 86/184] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:39 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:40.023927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-bc718604-01a7-45ff-b1ba-39d0c4b5654a req-994565db-56c8-46b6-838e-b2351becb4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "name": "network-vif-plugged", "status": "completed", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:40.036751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-bc718604-01a7-45ff-b1ba-39d0c4b5654a req-994565db-56c8-46b6-838e-b2351becb4de service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.038189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-bc718604-01a7-45ff-b1ba-39d0c4b5654a req-994565db-56c8-46b6-838e-b2351becb4de service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.055786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-bc718604-01a7-45ff-b1ba-39d0c4b5654a req-994565db-56c8-46b6-838e-b2351becb4de service nova] Creating event network-vif-plugged:6a6fc786-b0fd-4333-a1bb-cbc2584be0e0 for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 on hv-cinder-84721 Jun 22 19:39:40.061888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.067021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-bc718604-01a7-45ff-b1ba-39d0c4b5654a req-994565db-56c8-46b6-838e-b2351becb4de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045265 Jun 22 19:39:40.069148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 87/185] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:39:40.076929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.079296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.081241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1db84bce-507d-4cae-a2c1-9eec3afbf7d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.337254 Jun 22 19:39:40.082200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 99/186] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:39 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:40.157736 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:40.158553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:40.165153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.165621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.166378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.166796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.349295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.360292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:40.360489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-14cb1372-0f2d-45dd-9257-9511ab21552f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.206896 Jun 22 19:39:40.361048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 88/187] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:40.363566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:40.369964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.370419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.371254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.371691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.528886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.536568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a32dc923-ae66-436a-9c95-a84ef489cade tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.180279 Jun 22 19:39:40.537139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 100/188] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:40 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:40.580421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:40.581181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:40.587349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.587869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.588706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:40.589200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:40.725445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:40.733514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-88ce7dae-37c3-43d1-9336-08a88b6f1a01 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.156898 Jun 22 19:39:40.734090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 89/189] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:40 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:41.014286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:41.015007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:41.021128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.021564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.022335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.022786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.099833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:41.100457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:41.107317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.108126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.108917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.109353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.156766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.168351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5fe167fd-18f4-40cb-902b-5450f07d20c0 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.157790 Jun 22 19:39:41.169158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 101/190] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:41 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:41.246970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.255124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.256662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.257763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a5daf6ba-7ca9-41d1-abf5-9db90fca1f2f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.161858 Jun 22 19:39:41.258343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 90/191] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:41 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:41.377794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:41.378478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:41.385715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.386249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.387119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.387664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.550325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.554052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:41.555094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:41.562471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.563404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.565045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.565787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.569191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0e571f0b-f32f-42f5-b2db-da0ebd118874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.195421 Jun 22 19:39:41.569785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 102/192] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:41.715878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.725013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-64a25ef1-b6c6-40a2-b094-a30518d91770 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.175237 Jun 22 19:39:41.725752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 91/193] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:41 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:41.750165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:41.750906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:41.757703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.758349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.759252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:41.759700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:41.783345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:41.901645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:41.909811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bf625690-22ed-4389-828b-547547f13f65 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.163849 Jun 22 19:39:41.910384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 103/194] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:41 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:42.091353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-16621967-620b-4fe4-8495-3d83761bdae6 req-c3134ec2-24a5-4ff4-9f8b-2fc4f3fff6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4083c205-6284-4602-ac2f-c515a2c55045", "name": "network-vif-plugged", "status": "completed", "tag": "8ba90739-57c2-4418-bf14-93314c9639a7"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:42.101255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-16621967-620b-4fe4-8495-3d83761bdae6 req-c3134ec2-24a5-4ff4-9f8b-2fc4f3fff6a5 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.102225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-16621967-620b-4fe4-8495-3d83761bdae6 req-c3134ec2-24a5-4ff4-9f8b-2fc4f3fff6a5 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.115381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-16621967-620b-4fe4-8495-3d83761bdae6 req-c3134ec2-24a5-4ff4-9f8b-2fc4f3fff6a5 service nova] Creating event network-vif-plugged:8ba90739-57c2-4418-bf14-93314c9639a7 for instance 4083c205-6284-4602-ac2f-c515a2c55045 on hv-cinder-84721 Jun 22 19:39:42.120628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-16621967-620b-4fe4-8495-3d83761bdae6 req-c3134ec2-24a5-4ff4-9f8b-2fc4f3fff6a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Jun 22 19:39:42.121502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 92/195] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:42.186887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:42.188221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:42.195816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.196330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.197329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.198171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.286925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:42.289502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:42.303334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.304004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.305145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.305824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.390519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.399695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-da3621d9-e9ad-4b5a-97b9-e0919ec2d1f6 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.217042 Jun 22 19:39:42.400852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 104/196] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:42 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:42.588204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:42.588204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:42.596881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.597718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.598647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.599511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.740898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.748794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3564a5ec-15c9-416c-aa9f-4f669b47b277 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.166489 Jun 22 19:39:42.749374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 105/197] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:42.761746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:42.762345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:42.768875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.769341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.770140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.770540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.777088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.788678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.790380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.791650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8a299b36-abc7-4c82-b9fe-1b6d1eac5ac2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.519735 Jun 22 19:39:42.792792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 93/198] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:42 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:42.906934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:42.916092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3f8138cf-a678-454d-8aec-7ea3d580b84c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.165716 Jun 22 19:39:42.917325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 106/199] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:42 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:42.931189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:42.932087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:42.938013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.938450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:42.939199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:42.939618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.410962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:43.416707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:43.417311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:43.419053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-657f417b-0cd7-4711-abc8-0670de5ddf11 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.491610 Jun 22 19:39:43.419643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 94/200] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:42 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:43.425472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.426021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.426685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.427272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.567757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:43.575429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0db5363d-ecda-4202-a10e-ccb5a3a84361 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.162602 Jun 22 19:39:43.576067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 107/201] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:43 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:43.769831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:43.770717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:43.780234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.780915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.782983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.783878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.814920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:43.816026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:43.826647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.827103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.827877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:43.832481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:43.972435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:43.989030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85950ac1-5b5d-481a-8ce9-77e4ffaf08d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.227339 Jun 22 19:39:43.989633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 95/202] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:43 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:43.997011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:43.997678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:44.005008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.005451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.006219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.006735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.051730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.061187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.062732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.064056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ce707010-a91a-42bb-9c8e-434eb3e6e7b9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.253208 Jun 22 19:39:44.064624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 108/203] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:43 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:44.169221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.177003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-03302e6b-8f08-41d0-a950-cb71b5f10d3d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.186416 Jun 22 19:39:44.177612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 96/204] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:43 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:44.436752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:44.437605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:44.449626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.450080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.450857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.451290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.592355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:44.593544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:44.593898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.601021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.602240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.603363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:44.604014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:44.606133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a6dd0f72-5d4d-404b-aad3-b370a6528284 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.173990 Jun 22 19:39:44.621210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 109/205] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:44 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:44.754484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:44.762043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a512b870-f263-4afe-9219-2930bc93ee7a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.173636 Jun 22 19:39:44.762810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 97/206] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:44 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:45.009094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:45.009712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:45.019692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.020157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.021737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.022392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.082387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:45.083354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:45.096787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.099366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.100344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.100945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.230575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.239946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8567de55-48b0-42be-ada9-8e9ee5397847 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.234963 Jun 22 19:39:45.240627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 110/207] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:45.245436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:45.246110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:45.252569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.253269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.254233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.254999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.295163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.305568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.307326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.308618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90bcf627-5e5d-42c3-b701-efac6a301a8e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.230466 Jun 22 19:39:45.319731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 98/208] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:45 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:45.413251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.421628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d3d21ec1-eecf-4665-9a84-789c8ba36b68 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.179838 Jun 22 19:39:45.422450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 111/209] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:45 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:45.622825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:45.624003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:45.630590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.631070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.631863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.632354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.778695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:45.779187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.780131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:45.787455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.787905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.789121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:45.789700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:45.790849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37fccd8e-87f5-4c5e-9323-c3dcbb61c43d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.171822 Jun 22 19:39:45.791669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 99/210] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:45 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:45.951867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:45.959932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-15ae3d8d-4f05-4366-83d9-c2b329ca259b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.185108 Jun 22 19:39:45.960703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 112/211] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:45 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:46.219169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-1df75c84-6af7-4cf6-bbb7-a33b8a36e560 req-08c4f925-1fcd-4476-990c-ad524ff39e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef8e89-7e43-4a42-b7da-687e608695c5", "name": "network-vif-plugged", "status": "completed", "tag": "e41583d4-5f52-4552-b13a-7d8961e18154"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:46.231881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1df75c84-6af7-4cf6-bbb7-a33b8a36e560 req-08c4f925-1fcd-4476-990c-ad524ff39e8c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.232745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1df75c84-6af7-4cf6-bbb7-a33b8a36e560 req-08c4f925-1fcd-4476-990c-ad524ff39e8c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.245670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-1df75c84-6af7-4cf6-bbb7-a33b8a36e560 req-08c4f925-1fcd-4476-990c-ad524ff39e8c service nova] Creating event network-vif-plugged:e41583d4-5f52-4552-b13a-7d8961e18154 for instance 4bef8e89-7e43-4a42-b7da-687e608695c5 on hv-cinder-84721 Jun 22 19:39:46.251679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-1df75c84-6af7-4cf6-bbb7-a33b8a36e560 req-08c4f925-1fcd-4476-990c-ad524ff39e8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036853 Jun 22 19:39:46.252888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 100/212] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:46.258752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:46.259586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:46.266241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.267298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.268351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.270991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.327487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:46.328220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:46.335815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.336471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.337234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.338045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.344869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:46.453643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:46.461593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-09a62010-1720-41f6-b7f4-59c6aa9def37 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.208609 Jun 22 19:39:46.462823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 113/213] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:46.467991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:46.468841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:46.475836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.476507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.477884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.478562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.512317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:46.521370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:46.523038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:46.524390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-eb141ee5-9c64-4dc3-b0b4-760075df3d6f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.201812 Jun 22 19:39:46.534656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 101/214] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:46 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:46.633073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:46.641698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-929d1fe5-dc52-4a3c-812e-74ff39196e75 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.177571 Jun 22 19:39:46.642324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 114/215] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:46 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:46.808800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:46.809584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:46.817596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.818173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.819046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.819646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.988698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:46.990291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:46.997637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:46.998555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:46.999336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.000447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.190015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.200259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-77279b95-4ca2-4a58-b822-975dae9884ca tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.395899 Jun 22 19:39:47.201045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 102/216] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:46 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:47.254438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.267359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a4d91b55-ace1-42ae-8151-8d5882b69be1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.292118 Jun 22 19:39:47.279889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 115/217] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:46 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:47.479700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:47.480802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:47.488015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.488650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.489698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.490826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.542299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:47.543092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:47.550779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.551231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.552009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.552475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.695419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.704003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6b1836fb-4bf0-45e5-89e0-50b626297be6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.228579 Jun 22 19:39:47.705101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 103/218] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:47.710182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:47.710793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:47.717176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.717634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.718403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:47.718834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:47.729313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.742480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.744833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.746574 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-63e2d8ad-69d4-4917-8fdb-c3cc81ab89e9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.207855 Jun 22 19:39:47.747439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 116/219] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:47 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:47.983046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:47.990581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-119c299d-c74e-42c3-bcd3-5f719cd51793 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.284283 Jun 22 19:39:47.991211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 104/220] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:47 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:48.217495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:48.218100 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:48.229505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.231125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.232017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.233239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.287924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:48.288813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:48.296556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.297261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.299040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.299647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.443867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.454680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-73298493-c5c5-4331-b253-20d8a4d5e1fb tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.241313 Jun 22 19:39:48.456077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 117/221] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:48 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:48.483542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.492464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8afbc5c0-e4a7-4d37-9d0d-aad431818c0d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.210099 Jun 22 19:39:48.493126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 105/222] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:48 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:48.724836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:48.724836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:48.736210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.736721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.737493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.737923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.766821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:48.767944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:48.780888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.781552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.782391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:48.782830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:48.883474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.891152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-75f8b234-2949-43d3-8bb9-89b9bdb7ea96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.173154 Jun 22 19:39:48.899230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 118/223] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:48 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:48.933783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.941873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.943347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:48.944534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4f58b792-463f-4dde-b00c-d3ad9919e5e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.184130 Jun 22 19:39:48.945102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 106/224] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:48 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:49.007481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:49.008266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:49.026074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.026074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.026519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.027023 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.169149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:49.176749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eb66442f-6340-442b-b9ca-38465e64e93a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.173164 Jun 22 19:39:49.177328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 119/225] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:49 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:49.471464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:49.472069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:49.483796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.484477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.485609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.486190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.509436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:49.510621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:49.517092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.517850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.518806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.519230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.523541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:49.642406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:49.650195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3125bba6-f593-481a-bc82-3160ed524ae3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.182884 Jun 22 19:39:49.650798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 107/226] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:49 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:49.655346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1505332995", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:49.668153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:49.676137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0c7cdc65-5a76-40ef-8839-0312a69970f1 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.170641 Jun 22 19:39:49.676798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 120/227] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:49 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:49.704120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] validate_networks() for None {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:39:49.908181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:49.908994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:49.915496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.915945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.916922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.917352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.979781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:39:49.980223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:39:49.980694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:39:49.981096 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:39:49.981503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:39:49.990917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.991366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:49.992196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:49.992634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.014182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Getting quotas for project 633aaf852e014390b6c827bda1acf7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:39:50.018660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Getting quotas for user 510e47f215e74bf5bac5071f540f1569 and project 633aaf852e014390b6c827bda1acf7f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:39:50.030544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:39:50.032931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:39:50.107733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c43671cc-aa6d-4aaa-be6e-080454a447ef tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455752 Jun 22 19:39:50.108889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 108/228] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:39:50.116781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.123138 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:50.124544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:50.132901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f0082a2c-6a79-4235-8e94-da2a57766616 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.228621 Jun 22 19:39:50.137624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 121/229] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:50.141687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.142187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.142948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.143384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.148928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7df81f85-af55-4db2-8655-6fcb85fe126b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:50.151036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7df81f85-af55-4db2-8655-6fcb85fe126b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:50.219004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7df81f85-af55-4db2-8655-6fcb85fe126b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.229585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7df81f85-af55-4db2-8655-6fcb85fe126b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1215 microversion: 2.1 time: 0.089304 Jun 22 19:39:50.230191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 122/230] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:50 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:50.243932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:50.244573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:50.250952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.251287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.252124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.252564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.353309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.365307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.366513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.367656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b3f7ee9b-f9e2-41b8-85d3-b169a93218f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.257481 Jun 22 19:39:50.378228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 109/231] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:50 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:50.383764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-aded5822-bd9d-4ede-a0e1-534560528741 req-72984465-c65b-46b3-8763-f14ea046fff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60784b8-22f8-4043-9656-c629245206da", "name": "network-vif-plugged", "status": "completed", "tag": "c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:50.395481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-aded5822-bd9d-4ede-a0e1-534560528741 req-72984465-c65b-46b3-8763-f14ea046fff6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.395981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-aded5822-bd9d-4ede-a0e1-534560528741 req-72984465-c65b-46b3-8763-f14ea046fff6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.410226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-aded5822-bd9d-4ede-a0e1-534560528741 req-72984465-c65b-46b3-8763-f14ea046fff6 service nova] Creating event network-vif-plugged:c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f for instance e60784b8-22f8-4043-9656-c629245206da on hv-cinder-84721 Jun 22 19:39:50.410382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.415337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-aded5822-bd9d-4ede-a0e1-534560528741 req-72984465-c65b-46b3-8763-f14ea046fff6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035866 Jun 22 19:39:50.415942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 110/232] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:50.418588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-faf3e25f-eaad-495e-8d9e-535117c6e196 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.178440 Jun 22 19:39:50.419156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 123/233] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:50 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:50.667254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:50.668383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:50.675896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.676363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.677123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.677552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.692854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:50.694210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:50.700570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.701018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.701909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:50.702550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:50.840193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.848426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f9eb4ae9-7fe0-4a21-a33e-08b71d39288b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.185256 Jun 22 19:39:50.857952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 111/234] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:50 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:50.859157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:50.867089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a44b3197-4c17-43e2-9d8e-7d93fe1f7e65 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1314 microversion: 2.1 time: 0.178087 Jun 22 19:39:50.867903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 124/235] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:50 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:51.152799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.153398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.159632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.160085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.160839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.161447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.246909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.247517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.258773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.268161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.268161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.268161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.333874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.347152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3b9f98c3-92e8-4b11-ae9b-929cc52ccff5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1219 microversion: 2.1 time: 0.104010 Jun 22 19:39:51.349571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.356475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 125/236] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:51.372966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f18d23fd-85ad-4097-bea8-98779aba3453 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.223232 Jun 22 19:39:51.373554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 112/237] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:51.385554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.386216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.392483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.392986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.393751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.394180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.438339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.438945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.445082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.445530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.446293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.446728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.538139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.546393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.549092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.550412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c63fa94-92f2-46a1-9f36-1779700e541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.169005 Jun 22 19:39:51.551464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 126/238] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:51.867987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.868765 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.872138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:51.876811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.877447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.878209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.880143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.919605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:51.929655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8ec89790-69ff-4a9b-9fd2-0145b3d0bf28 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1321 microversion: 2.1 time: 0.495029 Jun 22 19:39:51.934327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 113/239] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:51.943699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:51.946245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:51.956860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.959736 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:51.960332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:51.960779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.014205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.022396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a99fe909-1777-490a-b397-ac6bc2698edf tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.158479 Jun 22 19:39:52.023467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 127/240] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:52.096741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.104953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1b29e7c5-bed7-4557-b6c0-e67d01ba08e3 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1499 microversion: 2.1 time: 0.169240 Jun 22 19:39:52.105603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 114/241] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:51 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:52.373789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:52.374435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:52.385382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.389503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.390104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:52.390721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:52.391508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.392352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.402685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.403182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.404181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.404953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.490945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.499187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48bedb68-9397-4d4c-a5be-e255ac03df7d tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.130320 Jun 22 19:39:52.509269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 128/242] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:52 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:52.568232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:52.568931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:52.574982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.575418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.576211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.576641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.584486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.593127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-32c404d0-09d0-41b3-9728-2ea7806b6e5c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.207415 Jun 22 19:39:52.593632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 115/243] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:52 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:52.718388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.726566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.728419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:52.729556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ddaa08ec-4001-476d-919f-d1cf5498fa6a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.165233 Jun 22 19:39:52.730125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 129/244] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:52 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:39:52.954061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:52.954985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:52.965459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.966189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:52.967415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:52.968166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.039047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:53.039765 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.046370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.046648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.047405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.047840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.102000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.109995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-97fd6f61-c6ea-4c4a-b4b7-e86664031285 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1516 microversion: 2.1 time: 0.162199 Jun 22 19:39:53.110516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 116/245] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:52 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:53.126613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:53.127759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.133915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.134366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.135132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.135563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.176671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.184130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9018ea88-4d83-4792-94d6-5fcd11ab14e4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.148944 Jun 22 19:39:53.184694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 130/246] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:53 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:53.196254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lazy-loading 'flavor' on Instance uuid 4083c205-6284-4602-ac2f-c515a2c55045 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:39:53.282617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:53.318943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-796ec442-d99a-4fe5-90a2-b80d0403a5c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045/action" status: 200 len: 32 microversion: 2.1 time: 0.196234 Jun 22 19:39:53.319574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 117/247] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:39:53 2022] POST /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 19:39:53.328648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:53.329243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.335468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.335908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.336686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.337110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.466584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.479956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d0a1ccd6-d94e-4f9e-a4c6-92e366f15ee7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.155126 Jun 22 19:39:53.480553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 131/248] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:53 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:53.521941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:53.522641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.529166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.529611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.530373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.530801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.597001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.605174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-97eabd5d-863c-4155-822d-a25e5e5370c1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.087536 Jun 22 19:39:53.605739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 118/249] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:53 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:53.610513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:53.611218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.619242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.619840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.621051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.621627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.747685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:53.748442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:53.751671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:53.755482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.756003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.756946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:53.757425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:53.759280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.766923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a7505271-79c4-418d-a67c-4a2d0c2edaea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.160221 Jun 22 19:39:53.767488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 132/250] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:53 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:53.894205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.902517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.904044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:53.905167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f4d9f8c1-7486-49d1-91de-bba425cf30a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.161482 Jun 22 19:39:53.905727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 119/251] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:53 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:54.204919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:54.205856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:54.213395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.213925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.214804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.215298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.361256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:54.368936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aed439cd-612c-4f83-9e6e-e928633c6c57 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.170469 Jun 22 19:39:54.369476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 133/252] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:54 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:54.498255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:54.499009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:54.511370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.511894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.512802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.513278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.622042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:54.622643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:54.629149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.629592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.630347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.630773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.641313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:54.649383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-54edf10e-c71f-44c4-beb1-700df15db60f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.155948 Jun 22 19:39:54.650081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 120/253] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:54 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:54.690243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:54.697592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-00948481-0bb2-466b-8cae-5fa0441efdcc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.079391 Jun 22 19:39:54.698159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 134/254] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:54 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:54.787463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:54.788383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:54.798514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.799213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.799974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.800508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.923001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:54.923687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:54.931605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.932184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.932987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:54.933480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:54.938997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:54.947161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-411d742d-1e01-4ddf-a2b1-f5c641f1cd2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.166244 Jun 22 19:39:54.947948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 121/255] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:55.059201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.067237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.068771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.069878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ef425b3e-e37d-4e4c-8960-6dc26f742e5f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1406 microversion: 2.20 time: 0.150888 Jun 22 19:39:55.070449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 135/256] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:54 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:55.390460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:55.391419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:55.401586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.402326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.403576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.404336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.540449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.548631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d45e8cf4-7736-46f9-bc21-33c3859062d1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.164821 Jun 22 19:39:55.549264 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 122/257] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:55 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:55.669579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:55.670388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:55.678228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.678673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.679429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.679856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.714551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:55.715143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:55.721487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.721930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.722679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.723103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.786222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.793546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-889a3f50-fd70-448f-826b-91bae01794bc tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.082706 Jun 22 19:39:55.794122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 123/258] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:55 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:55.810958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:55.818968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-710f76f7-3e94-4b7b-91d9-0280f509101f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.155867 Jun 22 19:39:55.819771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 136/259] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:55 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:55.964583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:55.965192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:55.971712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.972159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:55.972947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:55.973374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.089420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:56.090186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.097849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.098428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.099912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.100453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.109560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.117076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22c8039f-2ec0-472e-b840-3b586eb97a69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.156416 Jun 22 19:39:56.117643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 124/260] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:56.231454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.234960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:39:56.240532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.242216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.243369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4581b1f4-fc62-4fbb-bd12-e81fe35e4842 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1598 microversion: 2.20 time: 0.159083 Jun 22 19:39:56.243918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 137/261] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:39:56 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:39:56.261785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:56.262270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.268780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.269224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.269973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.270400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.353245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a8b48e7b-7321-4d92-bc56-4081903a5d47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095196 Jun 22 19:39:56.354103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 125/262] 10.222.0.26 () {60 vars in 1315 bytes} [Wed Jun 22 19:39:56 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:39:56.566258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:56.567076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.580902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.581520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.582398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.582830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.691129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd75c098-e29c-4ce1-b1a6-a018d6c1a3c0"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:56.698387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.723222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.724314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.726633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.727908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.771309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.781115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8b7f1e9c-77b8-4e36-96d4-f6534addfa1e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.219194 Jun 22 19:39:56.782078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 138/263] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:56 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:56.810423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:56.810936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.820603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.824511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.833613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.841246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.910026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:56.917594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-772587d2-d4cb-4abf-9bff-38a037dde85a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.111098 Jun 22 19:39:56.918196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 139/264] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:56 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:56.922700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:56.923287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:56.929227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.929799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:56.930573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:56.931001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.060536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:57.069539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1e548f8-2062-420b-a677-be2d25ceb3b5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.150367 Jun 22 19:39:57.070377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 140/265] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:56 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:57.135447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:57.136564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:57.145306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.145952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.147087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.147655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.305416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:57.314250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-37e8f47f-b8b7-4421-8e02-436f3ab82c96 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.183625 Jun 22 19:39:57.315559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 141/266] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:57.800817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:57.801604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:57.808052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.808517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.809283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.809717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.956777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:57.965733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1cd5ba39-249c-4e18-9a0c-ff3c5cb4e275 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.168251 Jun 22 19:39:57.975428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 142/267] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:57 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:57.980427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:57.981027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:57.988156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.988596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:57.989512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:57.990351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.092951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:58.101121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c3cd1a81-ec38-4163-b528-12969c4b0f0e tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.124583 Jun 22 19:39:58.102818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 143/268] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:57 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:58.107950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-cbcc935a-6006-43d4-920f-7de402c6da5b req-a80a7ba4-c669-4e11-beec-20fd3229cf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:39:58.117077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-cbcc935a-6006-43d4-920f-7de402c6da5b req-a80a7ba4-c669-4e11-beec-20fd3229cf4e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.117553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-cbcc935a-6006-43d4-920f-7de402c6da5b req-a80a7ba4-c669-4e11-beec-20fd3229cf4e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.128806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-cbcc935a-6006-43d4-920f-7de402c6da5b req-a80a7ba4-c669-4e11-beec-20fd3229cf4e service nova] Creating event network-changed:6a6fc786-b0fd-4333-a1bb-cbc2584be0e0 for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 on hv-cinder-84721 Jun 22 19:39:58.134276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-cbcc935a-6006-43d4-920f-7de402c6da5b req-a80a7ba4-c669-4e11-beec-20fd3229cf4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030011 Jun 22 19:39:58.135745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 144/269] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:39:58.141971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:58.142785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:58.149223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.149774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.150531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.150957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.307363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:58.316707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a0b9e3d9-d1a2-4af4-96fa-5217253ba015 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.179463 Jun 22 19:39:58.317343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 145/270] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:58 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:58.331942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:58.332631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:58.341493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.341938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.342731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.343145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.510711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:58.527590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b3ea2651-fcd8-46de-ab37-9221b5485825 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.199416 Jun 22 19:39:58.537225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 146/271] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:58 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:58.982076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:58.982691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:58.989118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.989882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:58.990730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:58.991232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.167669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:59.176356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-631f5862-87b8-4355-aaa2-768a0c3b9ac8 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.198020 Jun 22 19:39:59.177477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 147/272] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:58 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:59.182733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:59.183569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:59.190335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.191627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.192626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.193399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.268679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:59.277838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a0b9fc84-63ac-47df-8465-dcebd0053f0f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1211 microversion: 2.1 time: 0.098988 Jun 22 19:39:59.278958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 148/273] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:59 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:39:59.334854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:59.335878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:59.342593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.343029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.343790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.344248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.488060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:59.499018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6ed52e0e-ecd5-4015-8fa9-8b34d4c67067 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.169125 Jun 22 19:39:59.499725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 149/274] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:59 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:39:59.548918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:39:59.549776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:39:59.556331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.556768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.557592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:39:59.558037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:39:59.721415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:39:59.729605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5580acc3-b94f-4c7c-9c71-87253135b176 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.185110 Jun 22 19:39:59.732190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 150/275] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:39:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:00.000263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:00.025239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:00.194295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:00.194942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:00.201851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.202513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.203476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.204326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.228091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:00.528600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:00.541857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e656d7b0-3c8d-4afd-a966-d20b26a9ce8b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.350577 Jun 22 19:40:00.543316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 151/276] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:00 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:00.557315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:00.558143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:00.574034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.574809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.576172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.576942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.621427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b4f0df4b-d313-441f-89bc-6309133d7de7 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "POST /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.942433 Jun 22 19:40:00.622298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 126/277] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:39:56 2022] POST /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5/os-volume_attachments => generated 194 bytes in 3945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:40:00.628585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:00.629698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:00.638041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.638989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.640132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.640722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.709284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:00.724506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cd99b306-147a-48ca-80c5-193bf75398a9 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1267 microversion: 2.1 time: 0.174535 Jun 22 19:40:00.724506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 152/278] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:00 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:00.746920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:00.747593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:00.754705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.755291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.756201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:00.756700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:00.813570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:00.821601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d721394-a908-476b-be59-456e9e1f914b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.197911 Jun 22 19:40:00.822176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 127/279] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:00 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:00.891142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:00.899385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c6584d5-a13b-4556-8666-c87d7715c99b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.156557 Jun 22 19:40:00.899953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 153/280] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:01.559487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:01.560944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:01.573458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.573866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.574723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.575188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.711310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:01.718892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3391f059-082e-453a-a266-1fc4ca5ec1aa tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.163806 Jun 22 19:40:01.719465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 128/281] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:01 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:01.737980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:01.738680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:01.744857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.745394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.746283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.746810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.814332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:01.821792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9d159ec6-2e36-4422-b47d-50434b9c93d4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1275 microversion: 2.1 time: 0.088995 Jun 22 19:40:01.822564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 154/282] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:01 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:01.838473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:01.839085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:01.845820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.846269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.847074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.847507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.919103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:01.919103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:01.925535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.926308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.926916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:01.927536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:01.932265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:02.002081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:02.009499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a8e648d4-b374-4992-9479-55a4d32ad437 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.175058 Jun 22 19:40:02.018817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 129/283] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:01 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:02.061508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:02.069340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-868d7b13-4305-42a2-b086-bb4d44f64037 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.155301 Jun 22 19:40:02.069960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 155/284] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:02.736404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:02.737438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:02.744590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:02.745255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:02.746121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:02.746863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:02.841017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:02.841632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:02.857919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:02.857919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:02.858979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:02.859423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:02.953267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:02.968518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b29a4f43-f506-4a61-8792-b652e58100e4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1273 microversion: 2.1 time: 0.131771 Jun 22 19:40:02.969855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 156/285] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:02 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:02.977094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-f8c46738-a25e-4290-8f77-8e9e8571e8ac req-1142d08f-dbbc-45d4-85cd-a75eb8b35609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498198b2-0179-45ba-8753-15a2d61e7018", "name": "network-vif-plugged", "status": "completed", "tag": "122a26bf-0569-4fc7-a032-d4665ea55d7d"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:02.991195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f8c46738-a25e-4290-8f77-8e9e8571e8ac req-1142d08f-dbbc-45d4-85cd-a75eb8b35609 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:02.992289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f8c46738-a25e-4290-8f77-8e9e8571e8ac req-1142d08f-dbbc-45d4-85cd-a75eb8b35609 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.006016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-f8c46738-a25e-4290-8f77-8e9e8571e8ac req-1142d08f-dbbc-45d4-85cd-a75eb8b35609 service nova] Creating event network-vif-plugged:122a26bf-0569-4fc7-a032-d4665ea55d7d for instance 498198b2-0179-45ba-8753-15a2d61e7018 on hv-cinder-84721 Jun 22 19:40:03.012672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-f8c46738-a25e-4290-8f77-8e9e8571e8ac req-1142d08f-dbbc-45d4-85cd-a75eb8b35609 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Jun 22 19:40:03.013425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 157/286] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:03.026833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:03.027528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:03.033871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.034312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.035079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.035505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.121455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:03.129433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e9285012-2ca0-4094-9f31-3cfa889e8f41 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1367 microversion: 2.1 time: 0.397128 Jun 22 19:40:03.130012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 130/287] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:02 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:03.135907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:03.137131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:03.143540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.144349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.145660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.146343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.180071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:03.190883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-caeefab1-7ac9-4331-9687-d9a4711085e5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.168244 Jun 22 19:40:03.191468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 158/288] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:03 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:03.296457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:03.304231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a0e6308c-fa74-4889-ac6c-5ce7531f2e25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.172942 Jun 22 19:40:03.304804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 131/289] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:03 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:03.988647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:03.989297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:03.996982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.997648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:03.998602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:03.999205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.062666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:04.070309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52d16dd1-b037-40df-9b1b-bd4cf85a39dd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1273 microversion: 2.1 time: 0.087457 Jun 22 19:40:04.070872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 159/290] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:03 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:04.149697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:04.150356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:04.157352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.157811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.158651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.159083 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.208442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:04.209037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:04.215322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.216144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.220566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.222017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.371651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:04.375190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:04.380881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-51633d9d-0b41-452f-a565-e7e37c7c8de4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1556 microversion: 2.1 time: 0.235326 Jun 22 19:40:04.381956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 132/291] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:04 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:04.383089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:04.386713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:04.387471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:04.394218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.394669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.395462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.396013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.397196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9d64f8b1-1405-4e4c-9803-a7723c617ca3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.192481 Jun 22 19:40:04.398278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 160/292] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:04 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:04.412419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:04.413093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:04.419563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.420303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.421270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:04.421702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:04.544158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-441939c1-5022-4f2a-9fb7-a6bd59193e84 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135766 Jun 22 19:40:04.544735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 161/293] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 19:40:04 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:04.627436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:04.636738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e20b0c68-637e-4d5d-9b92-16a14fb42abd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.253383 Jun 22 19:40:04.642654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 133/294] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:05.088683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:05.089293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:05.097534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.097985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.098933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.099513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.416585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:05.417193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:05.425085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.425533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.426310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.426920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.493779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:05.502365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1ac7168e-f54f-4444-aca4-3492d60fad3a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.419084 Jun 22 19:40:05.503319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 162/295] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:05 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:05.563211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:05.571169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dc62b546-6522-44b7-9657-07b97a100f3f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.160253 Jun 22 19:40:05.571748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 134/296] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:05 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:05.653529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:05.654218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:05.660715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.661871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.662728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:05.663257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:05.910332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:05.918917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4d4e7aa-a0c0-42bd-8129-07a69365fe10 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1362 microversion: 2.1 time: 0.269366 Jun 22 19:40:05.928862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 163/297] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:06.131422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-183c609c-6a1b-48cb-9255-480c21f7d8f6 req-185f3f1e-3024-4b57-8024-6f35565005ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60784b8-22f8-4043-9656-c629245206da", "tag": "c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:06.140369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-183c609c-6a1b-48cb-9255-480c21f7d8f6 req-185f3f1e-3024-4b57-8024-6f35565005ea service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.140822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-183c609c-6a1b-48cb-9255-480c21f7d8f6 req-185f3f1e-3024-4b57-8024-6f35565005ea service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.153275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-183c609c-6a1b-48cb-9255-480c21f7d8f6 req-185f3f1e-3024-4b57-8024-6f35565005ea service nova] Creating event network-changed:c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f for instance e60784b8-22f8-4043-9656-c629245206da on hv-cinder-84721 Jun 22 19:40:06.158684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-183c609c-6a1b-48cb-9255-480c21f7d8f6 req-185f3f1e-3024-4b57-8024-6f35565005ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031155 Jun 22 19:40:06.159287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 135/298] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:06.519872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:06.520510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:06.533361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.533738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.534566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.535034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.590998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:06.592762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:06.600987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.602092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.604624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.605316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.722917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:06.731671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-972fcdd8-d043-445d-9ad3-d9fd0ad956e3 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.215891 Jun 22 19:40:06.732378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 164/299] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:06 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:06.802294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:06.824455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-61e90a86-b11c-4fd3-8ffa-c233ccf03a7b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.237880 Jun 22 19:40:06.825356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 136/300] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:06 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:06.913157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-be841487-caf3-4881-be4b-9d9259a90c20 req-7f669508-4177-4ca5-8aff-149b6deb7281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a470ad6-8ccb-4c94-9f56-365dc9c7e838", "tag": "60179f1a-6c01-4019-8640-e9a3aeddbec9"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:06.921812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-be841487-caf3-4881-be4b-9d9259a90c20 req-7f669508-4177-4ca5-8aff-149b6deb7281 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.922223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-be841487-caf3-4881-be4b-9d9259a90c20 req-7f669508-4177-4ca5-8aff-149b6deb7281 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.936705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:06.937863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:06.939260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-be841487-caf3-4881-be4b-9d9259a90c20 req-7f669508-4177-4ca5-8aff-149b6deb7281 service nova] Creating event network-changed:60179f1a-6c01-4019-8640-e9a3aeddbec9 for instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 on hv-cinder-84721 Jun 22 19:40:06.945675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.946428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.947380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:06.947989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:06.962333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-be841487-caf3-4881-be4b-9d9259a90c20 req-7f669508-4177-4ca5-8aff-149b6deb7281 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053284 Jun 22 19:40:06.963272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 165/301] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:07.114437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:07.122214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c7d76d47-7b19-4a9d-80c1-8bb7b9a77460 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1548 microversion: 2.1 time: 0.189951 Jun 22 19:40:07.122791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 137/302] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:07.143400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:07.144083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:07.151717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.152315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.153224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.153721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.252567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ab6f45c7-b431-438a-b27d-5bad452bce93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115256 Jun 22 19:40:07.258912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 166/303] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 19:40:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:07.748369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:07.750535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:07.757253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.757699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.758461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.758886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.842351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:07.843124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:07.863764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.870052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.871250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:07.873064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:07.993270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:08.000971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f62b6fe6-a6e1-4a8e-8378-316ef736bf7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.256256 Jun 22 19:40:08.004146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 138/304] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:07 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:08.219550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:08.229475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e00b7cd3-fddd-4a33-8909-27e4748cb745 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.391505 Jun 22 19:40:08.239421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 167/305] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:07 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:08.594673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-c38d9a9d-9af3-4479-832b-37aed549fc8b req-c23c18d0-3f5a-4941-88be-4561c7c47580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498198b2-0179-45ba-8753-15a2d61e7018", "tag": "122a26bf-0569-4fc7-a032-d4665ea55d7d"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:08.608984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c38d9a9d-9af3-4479-832b-37aed549fc8b req-c23c18d0-3f5a-4941-88be-4561c7c47580 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:08.609706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c38d9a9d-9af3-4479-832b-37aed549fc8b req-c23c18d0-3f5a-4941-88be-4561c7c47580 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:08.622793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-c38d9a9d-9af3-4479-832b-37aed549fc8b req-c23c18d0-3f5a-4941-88be-4561c7c47580 service nova] Creating event network-changed:122a26bf-0569-4fc7-a032-d4665ea55d7d for instance 498198b2-0179-45ba-8753-15a2d61e7018 on hv-cinder-84721 Jun 22 19:40:08.633197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-c38d9a9d-9af3-4479-832b-37aed549fc8b req-c23c18d0-3f5a-4941-88be-4561c7c47580 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037352 Jun 22 19:40:08.634253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 139/306] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:09.017768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:09.018336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:09.024722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:09.025152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:09.025930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:09.026353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:09.250411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:09.252076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:09.261042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:09.261935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:09.263379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:09.264011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:09.331727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:09.339452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7f258f63-31bb-48f7-8253-14ea5a33ec2f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.325659 Jun 22 19:40:09.340022 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 168/307] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:09 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:09.424543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:09.432284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0408a850-8054-4eb4-af48-a5da13928fa0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.189212 Jun 22 19:40:09.432856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 140/308] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:09 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:10.356924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:10.357650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:10.363751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:10.364234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:10.364988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:10.365448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:10.451442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:10.452042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:10.459304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:10.459895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:10.460577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:10.463096 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:10.515644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:10.523535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8eb3b8a1-caef-4d21-8516-f96cc6e78afa tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.170531 Jun 22 19:40:10.524043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 169/309] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:10 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:10.594858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:10.604279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6576cb6e-0e9c-4798-be30-f0ac563ebda7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.158020 Jun 22 19:40:10.604866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 141/310] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:10 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:11.539646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:11.540337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:11.547376 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:11.547825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:11.548651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:11.549087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:11.621059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:11.622197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:11.628649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:11.629151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:11.629925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:11.630506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:11.697362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:11.704921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d032390c-0de4-4f7d-b662-31c47f8d598b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.169138 Jun 22 19:40:11.705514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 170/311] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:11 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:11.772476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:11.780148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e54a4499-98f3-47f8-964f-a700e4bfd870 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.163182 Jun 22 19:40:11.780764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 142/312] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:11 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:12.722161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:12.722882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:12.731919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:12.732592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:12.733643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:12.734219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:12.797436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:12.798115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:12.805686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:12.806249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:12.807114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:12.808258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:12.873708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:12.881528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-201f83b0-8ac1-478f-9994-746051fc9936 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.163866 Jun 22 19:40:12.882096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 171/313] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:12 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:12.961787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:12.969456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-326ea7a9-3298-467e-8ece-893794120a01 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.175979 Jun 22 19:40:12.970032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 143/314] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:12 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:13.898763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:13.899439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:13.905858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:13.906300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:13.907072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:13.907540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:13.987410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:13.988359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:13.997598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:13.998040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:13.998803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:13.999523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:14.042948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:14.050527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48c73d8f-e9bc-4415-be93-9e22c9a45385 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.155769 Jun 22 19:40:14.051086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 172/315] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:13 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:14.134216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:14.145918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bcca604b-4699-402f-a8ad-c56cec5dc4ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.162649 Jun 22 19:40:14.146706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 144/316] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:13 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:15.067614 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:15.068948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:15.078617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:15.079219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:15.080549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:15.080987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:15.167362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:15.168050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:15.176780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:15.177237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:15.178005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:15.178438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:15.223146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:15.226972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:15.232055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0ccba2e8-b708-4cf5-a9d7-64d589608984 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.168756 Jun 22 19:40:15.232665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 173/317] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:15 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:15.319479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:15.327166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f828f113-bf47-4347-b754-5e521204e594 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.164578 Jun 22 19:40:15.327728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 145/318] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:15 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:16.253081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:16.253638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:16.260602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:16.261043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:16.261802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:16.262228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:16.346166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:16.347016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:16.363708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:16.364156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:16.365255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:16.365844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:16.410353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:16.418202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d4e7184f-9d65-4880-81a9-704ddafb24e1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.171275 Jun 22 19:40:16.427301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 174/319] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:16 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:16.502792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:16.519926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-02fe77d4-4d84-4d28-9d9d-8dbae3d0977e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.178360 Jun 22 19:40:16.520920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 146/320] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:16 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:17.434886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:17.435421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:17.441881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:17.442330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:17.443084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:17.443515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:17.537371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:17.537943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:17.545539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:17.545980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:17.546716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:17.547535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:17.573651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:17.581533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-322572a8-50dd-4354-bc66-744490a1e25b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.150663 Jun 22 19:40:17.582100 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 175/321] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:17 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:17.680128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:17.688372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8e67bf46-46c9-47ce-8769-9678e0bb5f4f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.154960 Jun 22 19:40:17.688885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 147/322] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:17 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:18.598361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:18.598920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:18.605474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:18.605913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:18.606692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:18.607111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:18.705578 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:18.706136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:18.713064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:18.713479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:18.714545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:18.714971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:18.739672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:18.747623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7c1ad791-9f8a-4726-b5cd-a768bf55b4d2 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.153169 Jun 22 19:40:18.748219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 176/323] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:18 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:18.863762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:18.871547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6b581e64-b061-4182-a81a-7cdb3d6c4f0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.169968 Jun 22 19:40:18.872133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 148/324] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:18 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:19.764587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:19.765209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:19.768295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:19.772077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:19.772562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:19.773426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:19.773898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:19.889159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:19.889880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:19.896865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:19.897310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:19.898120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:19.898522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:19.920736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:19.926943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e5f167fc-0c47-4d31-be55-fb53e1e4fa13 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.166360 Jun 22 19:40:19.927498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 177/325] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:19 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:20.028883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:20.037086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ef17e6eb-db2b-4ff6-954a-6480ad452815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.152237 Jun 22 19:40:20.037695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 149/326] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:19 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:20.733662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-16f62f4d-da92-4fe0-9180-6af210e788ba req-c480efca-0f16-44a7-b44e-e7ef856e211e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a470ad6-8ccb-4c94-9f56-365dc9c7e838", "name": "network-vif-plugged", "status": "completed", "tag": "60179f1a-6c01-4019-8640-e9a3aeddbec9"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:20.741886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-16f62f4d-da92-4fe0-9180-6af210e788ba req-c480efca-0f16-44a7-b44e-e7ef856e211e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:20.742327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-16f62f4d-da92-4fe0-9180-6af210e788ba req-c480efca-0f16-44a7-b44e-e7ef856e211e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:20.757522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-16f62f4d-da92-4fe0-9180-6af210e788ba req-c480efca-0f16-44a7-b44e-e7ef856e211e service nova] Creating event network-vif-plugged:60179f1a-6c01-4019-8640-e9a3aeddbec9 for instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 on hv-cinder-84721 Jun 22 19:40:20.762855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-16f62f4d-da92-4fe0-9180-6af210e788ba req-c480efca-0f16-44a7-b44e-e7ef856e211e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Jun 22 19:40:20.763611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 178/327] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:20.945031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:20.945617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:20.952661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:20.953099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:20.953857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:20.954287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:21.054795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:21.055479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:21.062717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:21.063159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:21.064166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:21.064624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:21.136670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:21.140303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:21.145221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ee0d0e6-bb4d-4c34-84c0-cb39248b1b3b tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.205234 Jun 22 19:40:21.145702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 150/328] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:20 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:21.198979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:21.208460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ec59be4-594d-4de9-ab3f-46011ac462db tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.157916 Jun 22 19:40:21.208996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 179/329] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:21 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:22.165961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:22.171980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:22.187115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:22.187850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:22.189831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:22.190510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:22.225569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:22.226186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:22.232876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:22.233320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:22.234140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:22.234573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:22.331014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:22.338452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7eb74493-f514-4482-86a9-e25f320f73a4 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.179118 Jun 22 19:40:22.339393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 151/330] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:22 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:22.365014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:22.372515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d82476c0-e13f-443a-887b-54087d53eaa3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.151005 Jun 22 19:40:22.373069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 180/331] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:22 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:23.355236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:23.355838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:23.363490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:23.364118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:23.365047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:23.365484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:23.389269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:23.389846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:23.395994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:23.396480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:23.397268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:23.397749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:23.497957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:23.505568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c0a4ea7f-8396-46ef-b7bd-7e7d57ba1425 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1315 microversion: 2.1 time: 0.154538 Jun 22 19:40:23.506177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 152/332] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:23 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:23.527259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:23.534705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-423240fd-30b5-4db0-948c-d01a7ed6c7c6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.149303 Jun 22 19:40:23.535266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 181/333] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:23 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:24.522362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:24.522950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:24.525299 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=67 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:24.532682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.533202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.534251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.534514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.551363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:24.551966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:24.559018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.559489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.560283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.560710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.672280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:24.679963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7b144ed5-07a5-4124-9177-50e03056395c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1464 microversion: 2.1 time: 0.161450 Jun 22 19:40:24.680504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 153/334] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:24 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:24.694357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:24.703422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-66a43b08-4184-4976-9396-9a7309f437e6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.154931 Jun 22 19:40:24.704018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 182/335] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:24 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:24.719827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:24.720357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:24.726810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.727279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.728023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.728472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.752617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:40:24.842975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cd183937-a836-46f9-892e-946fb66c05af tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 204 len: 0 microversion: 2.1 time: 0.127027 Jun 22 19:40:24.843550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 154/336] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:40:24 2022] DELETE /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 19:40:24.851991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:24.852988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:24.859125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.859569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.860381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:24.860815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:24.994401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:25.002319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-341301eb-7830-43b5-812a-992b5dcb82bd tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1470 microversion: 2.1 time: 0.154448 Jun 22 19:40:25.002889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 183/337] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:24 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:25.722937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:25.723629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:25.731072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:25.731517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:25.732302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:25.732725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:25.883263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:25.891326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24a3a6e2-58fc-4e9d-bb49-726a9e5b6d0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.172622 Jun 22 19:40:25.891970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 155/338] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:25 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:26.019209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:26.019835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:26.026382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:26.026836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:26.027613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:26.028050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:26.165131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:26.172837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-62e765e4-d3c9-4482-a942-02d1295b157a tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1470 microversion: 2.1 time: 0.157566 Jun 22 19:40:26.173403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 184/339] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:26 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:26.910802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:26.911356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:26.917765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:26.918204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:26.918945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:26.919365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:27.054012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:27.062318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7a8316ef-291e-46b8-8b03-daba5106a6f1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.156903 Jun 22 19:40:27.062886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 156/340] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:26 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:27.194131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:27.195135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:27.205908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:27.206357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:27.207133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:27.207560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:27.336739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:27.344840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-555ea4f8-3104-4df0-b90d-211321c22d48 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1470 microversion: 2.1 time: 0.157932 Jun 22 19:40:27.345388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 185/341] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:27 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:28.081354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:28.082135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:28.091050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:28.091650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:28.092719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:28.093295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:28.241058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:28.249025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-553b9d31-ece8-4fbc-9849-7d6baca3c417 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.173011 Jun 22 19:40:28.249584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 157/342] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:28 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:28.366991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:28.367990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:28.377925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:28.378368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:28.379139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:28.379571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:28.511431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:28.519412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5f346527-ad8f-479f-b3cc-23b9a8c52eab tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1470 microversion: 2.1 time: 0.159382 Jun 22 19:40:28.519972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 186/343] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:28 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:29.268942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:29.269543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:29.276409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:29.276847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:29.277593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:29.278011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:29.451470 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:29.458975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c576705b-7eda-4def-84b2-c98160dfc715 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.195749 Jun 22 19:40:29.459546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 158/344] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:29 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:29.543775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:29.544432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:29.553965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:29.554751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:29.555848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:29.556394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:29.695414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:29.704760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-10367820-09a9-4e59-a920-246af5af1fd1 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1470 microversion: 2.1 time: 0.172073 Jun 22 19:40:29.705384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 187/345] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:29 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:30.224363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-26f1959a-17c4-4a22-b737-cd99a135a892 req-bff6141f-f2d6-4599-b9ae-47dcefb03a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a470ad6-8ccb-4c94-9f56-365dc9c7e838", "name": "network-vif-deleted", "tag": "60179f1a-6c01-4019-8640-e9a3aeddbec9"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:30.233624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-26f1959a-17c4-4a22-b737-cd99a135a892 req-bff6141f-f2d6-4599-b9ae-47dcefb03a45 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.234306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-26f1959a-17c4-4a22-b737-cd99a135a892 req-bff6141f-f2d6-4599-b9ae-47dcefb03a45 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.246188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-26f1959a-17c4-4a22-b737-cd99a135a892 req-bff6141f-f2d6-4599-b9ae-47dcefb03a45 service nova] Creating event network-vif-deleted:60179f1a-6c01-4019-8640-e9a3aeddbec9 for instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 on hv-cinder-84721 Jun 22 19:40:30.251608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-26f1959a-17c4-4a22-b737-cd99a135a892 req-bff6141f-f2d6-4599-b9ae-47dcefb03a45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Jun 22 19:40:30.252317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 159/346] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:30.476224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:30.477182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:30.483397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.483837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.484632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.485062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.604082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:30.604828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:30.611679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.612128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.612901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.613651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.628082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:30.635974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2fafc1f0-3813-4dde-b2ac-215a5032a198 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.163680 Jun 22 19:40:30.637027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 188/347] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:30 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:30.640449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:40:30.721826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:30.722559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:30.727738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aa55d388-1c57-468f-a2b4-70dde5a4e6a2 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 204 len: 0 microversion: 2.1 time: 0.128126 Jun 22 19:40:30.729390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 160/348] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:40:30 2022] DELETE /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:40:30.734773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.735225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.736005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.736536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.738796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:30.739730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:30.745967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.746512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.747400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.747923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.768026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:30.768505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:30.768965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lazy-loading 'fault' on Instance uuid 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:40:30.820281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:30.827775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-048242a6-bad0-4f66-bd0e-98fa56bab1e5 tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1305 microversion: 2.1 time: 0.109923 Jun 22 19:40:30.828373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 189/349] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:30 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:30.885009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:30.893127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0ebf3553-96df-4bdc-89eb-679b4bfea760 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1551 microversion: 2.1 time: 0.159712 Jun 22 19:40:30.893714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 161/350] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:30 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:31.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:31.654508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:31.662142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.662599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.663441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.663899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.795774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:31.799411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:31.805606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0050366e-35d9-4f54-bc11-ae6495acbb26 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.155940 Jun 22 19:40:31.814903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 190/351] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:31 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:31.844317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:31.844951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:31.852390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.852823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.853578 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.854025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.890437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.890921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.891449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lazy-loading 'fault' on Instance uuid 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:40:31.911206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:31.911803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:31.918275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.918689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.919465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:31.919887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:31.940488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510e47f215e74bf5bac5071f540f1569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633aaf852e014390b6c827bda1acf7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:31.948354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fc2ef0ef-e172-4a81-a8de-1ece63986b9c tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 200 len: 1305 microversion: 2.1 time: 0.108097 Jun 22 19:40:31.948957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 162/352] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:31 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:32.049720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:32.058114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e378c3b4-8ffc-401c-9f09-960ba023125b tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1551 microversion: 2.1 time: 0.151060 Jun 22 19:40:32.058801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 191/353] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:31 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:32.822782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:32.824059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:32.831180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:32.831939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:32.832754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:32.833181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:32.966198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:32.966989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] [instance: 9a470ad6-8ccb-4c94-9f56-365dc9c7e838] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:32.975517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:32.980039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:32.980497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:32.981395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:32.981899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:32.988369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7b6a66d6-3e2a-4863-b249-c76e704d6bd2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.169503 Jun 22 19:40:32.991484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 163/354] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:32 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:32.998931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] HTTP exception thrown: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Request method failure captured: Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 HTTP/1.1 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3ADX-lZWGiKRveoX1KdxGMvwKvItxE2d5GpHElPf21ZhpmXj9-nZlzUgZk9ueKEiB0roKSAu1jDsGN-DIcRIN_JXavT5y3FQ8_7xAUuI0363j7RkMiPsKYmCi7YahjhaBdCTHO7TmqqcVSlFJ3BsyPJsnrnX1_2nIbs6CAP0bMIGvA Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 633aaf852e014390b6c827bda1acf7f2 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesNegativeTest-534926105 Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:40:33.003517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_633aaf852e014390b6c827bda1acf7f2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/633aaf852e014390b6c827bda1acf7f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/633aaf852e014390b6c827bda1acf7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/633aaf852e014390b6c827bda1acf7f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesNegativeTest-534926105 Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 633aaf852e014390b6c827bda1acf7f2 Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesNegativeTest-534926105 Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesNegativeTest-534926105-project Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 510e47f215e74bf5bac5071f540f1569 Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesNegativeTest-534926105-project Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. Jun 22 19:40:33.005067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '9a470ad6-8ccb-4c94-9f56-365dc9c7e838'} Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:40:33.005920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. Jun 22 19:40:33.007278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:33.008500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] Returning 404 to user: Instance 9a470ad6-8ccb-4c94-9f56-365dc9c7e838 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:40:33.008500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9549d029-7657-4f84-82d8-7adaac3ffe7f tempest-VolumesNegativeTest-534926105 tempest-VolumesNegativeTest-534926105-project] 10.222.0.26 "GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838" status: 404 len: 111 microversion: 2.1 time: 0.044178 Jun 22 19:40:33.008500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 192/355] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:32 2022] GET /compute/v2.1/servers/9a470ad6-8ccb-4c94-9f56-365dc9c7e838 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 19:40:33.075392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:33.076010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:33.088407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:33.089290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:33.090192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:33.090819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:33.111653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:33.241071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:33.249219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8fc3fa40-bc2c-4251-8262-21f61ed9c1f4 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1551 microversion: 2.1 time: 0.177603 Jun 22 19:40:33.249788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 164/356] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:33 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:34.005556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:34.006091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:34.012205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:34.012725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:34.013686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:34.014206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:34.174293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:34.186256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1a9d71c-46ea-4a6b-acf3-a87889506f71 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.184597 Jun 22 19:40:34.186962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 193/357] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:34 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:34.266583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:34.267965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:34.279527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:34.280174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:34.281118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:34.281725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:34.302763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-3b27d8e1-66c1-47ff-84a4-9b75e7fd9088 req-f62f3089-9a32-401c-af03-67ba183e44ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef8e89-7e43-4a42-b7da-687e608695c5", "name": "network-vif-deleted", "tag": "e41583d4-5f52-4552-b13a-7d8961e18154"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:34.312643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-3b27d8e1-66c1-47ff-84a4-9b75e7fd9088 req-f62f3089-9a32-401c-af03-67ba183e44ea service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:34.313335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-3b27d8e1-66c1-47ff-84a4-9b75e7fd9088 req-f62f3089-9a32-401c-af03-67ba183e44ea service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:34.340874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-3b27d8e1-66c1-47ff-84a4-9b75e7fd9088 req-f62f3089-9a32-401c-af03-67ba183e44ea service nova] Creating event network-vif-deleted:e41583d4-5f52-4552-b13a-7d8961e18154 for instance 4bef8e89-7e43-4a42-b7da-687e608695c5 on hv-cinder-84721 Jun 22 19:40:34.365625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-3b27d8e1-66c1-47ff-84a4-9b75e7fd9088 req-f62f3089-9a32-401c-af03-67ba183e44ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071786 Jun 22 19:40:34.366435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 194/358] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:40:34.388854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78b437b24d242d0bbfb61f14fd4c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec9412c5d834e34a3b7512134211191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:34.399145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-40462aec-6e39-40f6-bfae-ad3c9eb2ad6d tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 200 len: 1509 microversion: 2.1 time: 0.137070 Jun 22 19:40:34.399892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 165/359] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:34 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 1509 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:35.203956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:35.205472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:35.211795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.212277 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.213049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.213644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.392219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:35.402641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-71a97882-d0ab-48fa-8331-60651a47885c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.203409 Jun 22 19:40:35.403243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 195/360] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:35 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:35.420357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:35.421570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:35.428587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.429585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.431646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.432316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.451659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] HTTP exception thrown: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Request method failure captured: Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 HTTP/1.1 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_LWHL9FTIbJN5An1V8E8mT9vn8maywck_LgzWOSVihF2Fh-m3YuUrgRsBBbktZPVGZ1_pI30jqaTeRhC_kSaEktxVdzVgshomFDpLhiIvulM5rvN8fb7fyZafIDkgEc81nSgEjVXjDgomn1C8Sr5bqXQYp-JCZugQIfm60I_ssq9Q Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:40:35.456555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ec9412c5d834e34a3b7512134211191", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: a78b437b24d242d0bbfb61f14fd4c85b Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.458022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '4bef8e89-7e43-4a42-b7da-687e608695c5'} Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:40:35.458894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.460257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.461384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Returning 404 to user: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:40:35.477070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-df676308-8e5b-45a8-9ce7-689aece2adbe tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 404 len: 111 microversion: 2.1 time: 0.060153 Jun 22 19:40:35.478334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 166/361] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:35 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:40:35.606003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:35.607398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:35.614234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.614878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.615635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:35.616246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:35.631967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] HTTP exception thrown: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Request method failure captured: Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5/os-volume_attachments HTTP/1.1 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_LWHL9FTIbJN5An1V8E8mT9vn8maywck_LgzWOSVihF2Fh-m3YuUrgRsBBbktZPVGZ1_pI30jqaTeRhC_kSaEktxVdzVgshomFDpLhiIvulM5rvN8fb7fyZafIDkgEc81nSgEjVXjDgomn1C8Sr5bqXQYp-JCZugQIfm60I_ssq9Q Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:40:35.634986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ec9412c5d834e34a3b7512134211191", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: a78b437b24d242d0bbfb61f14fd4c85b Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.636505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'server_id': '4bef8e89-7e43-4a42-b7da-687e608695c5'} Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:40:35.637320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:35.638771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:35.640520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Returning 404 to user: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:40:35.640520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ac56afe3-e3f6-4921-843e-30f3dc1cf816 tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039141 Jun 22 19:40:35.640520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 196/362] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:40:35 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:40:36.422909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:36.423697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:36.432369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.432959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.434043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.434642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.573400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:36.581387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-185616db-fda4-4533-8c64-4dd49d6c4e9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.163862 Jun 22 19:40:36.581968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 167/363] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:36 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:36.868666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:36.869168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:36.875938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.876408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.877190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.877612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.891316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] HTTP exception thrown: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Request method failure captured: Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 HTTP/1.1 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_LWHL9FTIbJN5An1V8E8mT9vn8maywck_LgzWOSVihF2Fh-m3YuUrgRsBBbktZPVGZ1_pI30jqaTeRhC_kSaEktxVdzVgshomFDpLhiIvulM5rvN8fb7fyZafIDkgEc81nSgEjVXjDgomn1C8Sr5bqXQYp-JCZugQIfm60I_ssq9Q Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:40:36.893006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ec9412c5d834e34a3b7512134211191", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: a78b437b24d242d0bbfb61f14fd4c85b Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.894413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '4bef8e89-7e43-4a42-b7da-687e608695c5'} Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:40:36.895222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.896755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.898316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Returning 404 to user: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:40:36.898316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9ada3a7c-6f7a-4e8c-8efb-cb68fa4b8e3a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 404 len: 111 microversion: 2.1 time: 0.030357 Jun 22 19:40:36.898316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 197/364] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:40:36 2022] DELETE /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:40:36.903341 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:36.903956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] [instance: 4bef8e89-7e43-4a42-b7da-687e608695c5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:36.910396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.910844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.911642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:36.912076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:36.928360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] HTTP exception thrown: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Request method failure captured: Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 HTTP/1.1 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_LWHL9FTIbJN5An1V8E8mT9vn8maywck_LgzWOSVihF2Fh-m3YuUrgRsBBbktZPVGZ1_pI30jqaTeRhC_kSaEktxVdzVgshomFDpLhiIvulM5rvN8fb7fyZafIDkgEc81nSgEjVXjDgomn1C8Sr5bqXQYp-JCZugQIfm60I_ssq9Q Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:40:36.929880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ec9412c5d834e34a3b7512134211191", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ec9412c5d834e34a3b7512134211191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 6ec9412c5d834e34a3b7512134211191 Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226635565 Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: a78b437b24d242d0bbfb61f14fd4c85b Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-DeleteServersTestJSON-1226635565-project Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.931366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '4bef8e89-7e43-4a42-b7da-687e608695c5'} Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:40:36.932243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. Jun 22 19:40:36.933589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:40:36.934758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] Returning 404 to user: Instance 4bef8e89-7e43-4a42-b7da-687e608695c5 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:40:36.934758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-44058451-1afb-476b-825f-9daa664e140a tempest-DeleteServersTestJSON-1226635565 tempest-DeleteServersTestJSON-1226635565-project] 10.222.0.26 "GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5" status: 404 len: 111 microversion: 2.1 time: 0.032116 Jun 22 19:40:36.934758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 168/365] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:36 2022] GET /compute/v2.1/servers/4bef8e89-7e43-4a42-b7da-687e608695c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:40:37.601256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:37.603131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:37.633917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:37.636593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:37.641962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:37.642889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:38.085806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:38.096748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e85205a4-9f89-4dc3-8c3c-bab37f84b337 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.502713 Jun 22 19:40:38.097403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 198/366] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:37 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:39.114510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:39.115433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:39.122284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:39.122996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:39.123858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:39.124412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:39.283706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:39.293577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ab2361f9-acce-401d-a31f-1bf4d92cb884 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.183482 Jun 22 19:40:39.304065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 169/367] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:39 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:40.310835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:40.311449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:40.318652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:40.319160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:40.319978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:40.321139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:40.587628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:40.597665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52b887fe-769c-45f0-b712-7c68e1d83a42 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.290372 Jun 22 19:40:40.599584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 199/368] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:40 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:41.616210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:41.616810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:41.623598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:41.623978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:41.624779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:41.625210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:41.755483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:41.763800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-57554673-2883-4cc6-8a20-702b5bcd20bd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.151172 Jun 22 19:40:41.772685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 170/369] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:41 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:42.782664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:42.783772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:42.793350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:42.793928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:42.795016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:42.795683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:42.930020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:42.941395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-94be6ee6-72ca-4995-98ed-2e64ce92d2e7 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.163986 Jun 22 19:40:42.942110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 200/370] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:42 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:43.967070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:43.967994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:43.975907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:43.976769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:43.977469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:43.977930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:44.111804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:44.119775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9644ad15-bbdd-43ee-824b-a3209abae0c9 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.159636 Jun 22 19:40:44.120407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 171/371] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:43 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:45.136268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:45.137426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:45.145183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:45.145919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:45.147025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:45.147625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:45.281548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:45.289661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3592687b-845d-4548-8fa1-4b20d8fd3fb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.157171 Jun 22 19:40:45.290243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 201/372] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:45 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:46.307573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:46.308212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:46.314984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:46.315502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:46.316420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:46.316892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:46.458242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:46.466354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-743f2246-29bb-4d98-85de-da49bc9dee12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.162594 Jun 22 19:40:46.466934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 172/373] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:46 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:47.483560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:47.484689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:47.490731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:47.491162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:47.491967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:47.492398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:47.628955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:47.636983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-85867a28-17ad-46a4-a21e-99d94e89c5e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.157407 Jun 22 19:40:47.637548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 202/374] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:47 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:48.657144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:48.658176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:48.665649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:48.666115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:48.666981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:48.667452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:48.798351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:48.806376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b16d9edd-da96-494f-a4a8-32cfc97a9afc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.155702 Jun 22 19:40:48.806941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 173/375] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:48 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:49.831821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:49.832883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:49.835930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=53 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:49.844436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:49.845184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:49.846138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:49.846569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:49.998040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:50.006223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34657f13-f94f-478e-871f-e958479f64ed tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.180768 Jun 22 19:40:50.006762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 203/376] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:49 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:51.027788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:51.028829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:51.039941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:51.040740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:51.041993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:51.042709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:51.189579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:51.197238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-44ebe977-bf36-4572-917f-b0e25e50568c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.176149 Jun 22 19:40:51.197820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 174/377] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:51 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:52.214214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:52.214767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:52.221461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:52.221901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:52.222664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:52.223094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:52.353841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:52.363681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4cc908c0-8f80-4836-bccc-16c51456e412 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.153291 Jun 22 19:40:52.364518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 204/378] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:52 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:53.389205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:53.390218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:53.398332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:53.398842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:53.399643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:53.400121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:53.536968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:53.544815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c4ef88c3-cb27-4961-ae3c-e6d26d80ac6c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1522 microversion: 2.1 time: 0.162233 Jun 22 19:40:53.545389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 175/379] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:53 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:54.564379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:54.565451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:54.574156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:54.574875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:54.575933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:54.576496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:54.752322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:54.761813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bc19a661-22f3-4382-b0f9-b4668b1f13b1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1502 microversion: 2.1 time: 0.204139 Jun 22 19:40:54.765058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 205/380] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:54 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:54.777350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:54.777942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:54.780393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:40:54.787444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:54.788597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:54.789971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:54.790704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:54.938307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:54.947333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8419f3f6-2313-4129-a0a8-5483ac007675 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1515 microversion: 2.1 time: 0.173717 Jun 22 19:40:54.948840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 176/381] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:54 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:40:57.401251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:40:57.402372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:57.409485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:57.410082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:57.410955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:57.411486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:57.441613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lazy-loading 'flavor' on Instance uuid 9ebc14a2-64d9-4c3a-b545-f37268103753 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:40:57.575415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-36b6de85-c26d-4171-8b6b-5e0b5e38ed0d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/action" status: 200 len: 32 microversion: 2.1 time: 0.179216 Jun 22 19:40:57.576523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 206/382] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:40:57 2022] POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 19:40:57.585894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:57.587207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:57.593679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:57.594363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:57.595350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:57.595949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:58.225027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:58.234863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5d6bf2fd-694a-4bc9-b832-c4242f738292 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.653118 Jun 22 19:40:58.245350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 177/383] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:57 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:40:59.253162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:40:59.253867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:40:59.260545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:59.261473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:59.262412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:40:59.262999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:40:59.478129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:40:59.489333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa190747-1ca4-403c-a051-d66525e9904d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.240698 Jun 22 19:40:59.492935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 207/384] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:40:59 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:00.508631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:00.510552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:00.521023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:00.521989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:00.522991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:00.523646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:00.772475 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:00.781566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2026edd7-7357-43a8-b77c-5460fbd7575a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.278884 Jun 22 19:41:00.782581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 178/385] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:00 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:01.800983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:01.801599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:01.808091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:01.808622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:01.809265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:01.809722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:01.814814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:02.091622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:02.100193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af55677c-7506-42c2-baeb-06b376695ea1 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.304611 Jun 22 19:41:02.100838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 208/386] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:01 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:03.121944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:03.123497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:03.139719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:03.140679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:03.141881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:03.142491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:03.184633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=79 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:03.395421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:03.410974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e5ca2574-6fa1-481b-9f6f-8a114107ecb3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.296865 Jun 22 19:41:03.421076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 179/387] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:03 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:04.427205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:04.428538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:04.435330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:04.440007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:04.441098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:04.441680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:04.663240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:04.675723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-12183676-b483-4e24-987a-7233376d69ef tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.251471 Jun 22 19:41:04.686297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 209/388] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:04 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:05.693409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:05.694725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:05.702394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:05.703107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:05.704148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:05.704758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:05.893433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:05.908716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-380f3b9d-42d7-4841-a46a-fef32c0c8b08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.219132 Jun 22 19:41:05.918639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 180/389] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:05 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:06.537340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8f58e5c9-e5e8-43b2-982d-321f3617e9ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Action: 'create', calling method: .version_select at 0x7fdc19e5e670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1681006282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0JthEQO0aZIDKGIVbfQd/pavsKP1/buVxI5l3sC49VNLQrH49/g+p2X5G3xayyGXSEwHelKttK65ElDWcR9cMcz4I+tBtnP5rWAEU9GGWAOPeOT5mZjBHdWm3EQtM6hA=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:06.566158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-8f58e5c9-e5e8-43b2-982d-321f3617e9ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Getting quotas for project 533866da89004b95bb450a4dec134531. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:41:06.571542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-8f58e5c9-e5e8-43b2-982d-321f3617e9ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Getting quotas for user 18b20561384a4329819a078e44cb82bb and project 533866da89004b95bb450a4dec134531. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:41:06.600196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8f58e5c9-e5e8-43b2-982d-321f3617e9ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.325754 Jun 22 19:41:06.600852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 210/390] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:41:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:06.926119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:06.926796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:06.934097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:06.934506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:06.935401 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:06.937933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:07.136755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:07.145922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-63561ab0-84e5-409e-aec2-c9b2fcdf66f5 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.224333 Jun 22 19:41:07.146550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 181/391] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:06 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:08.163374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:08.164065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:08.170921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:08.171469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:08.172678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:08.173324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:08.331655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:08.339754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-899698ca-c444-436a-8ad1-a94d5db7f815 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.180865 Jun 22 19:41:08.340352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 211/392] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:08 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:09.358240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:09.359547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:09.366568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:09.368954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:09.370016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:09.370515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:09.584091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:09.593469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-97653fd3-9264-4868-8c09-0bf4a2663921 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.239917 Jun 22 19:41:09.604269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 182/393] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:09 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:10.614980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:10.615555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:10.621650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:10.622092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:10.622850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:10.623276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:10.753179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:10.761089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c426cdc6-ebcb-4b92-9e58-09e2f6dbe363 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.152112 Jun 22 19:41:10.761660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 212/394] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:10 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:11.782095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:11.782842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:11.789972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:11.790437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:11.791224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:11.791672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:11.923328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:11.931209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f23c26ee-a778-4953-bb25-0943d91fec08 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.155663 Jun 22 19:41:11.931794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 183/395] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:11 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:12.948776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:12.949365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:12.956587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:12.957035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:12.957803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:12.958234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:13.100284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:13.108402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6a8b454b-6373-4085-90cd-c0241e0a2c0e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.163503 Jun 22 19:41:13.109238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 213/396] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:12 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:14.128437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:14.129051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:14.136204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:14.136649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:14.137412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:14.137838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:14.267159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:14.274834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-de9c5ae3-5284-4940-ba67-0387bb53cbcb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.151597 Jun 22 19:41:14.275402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 184/397] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:14 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:15.293920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:15.294700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:15.302571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:15.304244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:15.305113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:15.305543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:15.441103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:15.450162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4730d3a-7c85-44a7-896b-a446bffdb836 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.161063 Jun 22 19:41:15.450736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 214/398] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:15 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:16.467552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:16.468765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:16.478082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:16.478541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:16.479305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:16.479725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:16.629631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:16.640381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-81eb8c3b-f994-45f0-a6b1-a31b022ab874 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.176697 Jun 22 19:41:16.651011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 185/399] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:16 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:17.658712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:17.659320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:17.661149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:17.666786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:17.667230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:17.667972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:17.668426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:17.805652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:17.813443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6e8648d2-2f32-41ad-af97-a45e4696525c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.158854 Jun 22 19:41:17.814050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 215/400] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:17 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:18.830772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:18.831501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:18.843247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:18.843608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:18.844396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:18.844822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:18.977003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:18.986262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4deb0746-5dd6-4544-ae06-ff4bcddd7e12 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.159254 Jun 22 19:41:18.997926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 186/401] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:18 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:20.012548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:20.015433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:20.019564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:20.032602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:20.033351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:20.034663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:20.035074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:20.167445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:20.175640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-62d43eb4-7dc2-4b4a-8c0b-a8d8dea95a38 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.173224 Jun 22 19:41:20.176187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 216/402] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:20 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:21.197253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:21.198237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:21.207906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:21.208389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:21.209157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:21.209591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:21.342779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:21.352026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-98d7f8ef-b930-426b-859d-f77e4ef9e70d tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.162194 Jun 22 19:41:21.352646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 187/403] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:21 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:22.373006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:22.374126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:22.382198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:22.382673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:22.383428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:22.383852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:22.513107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:22.520826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-772d500a-5816-46e0-9ce3-092593bc92bc tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.154244 Jun 22 19:41:22.521413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 217/404] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:22 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:23.539781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:23.540569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:23.548465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:23.549028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:23.550029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:23.550555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:23.684713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:23.692845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-26ace8cf-9420-4e02-89da-38657e18823e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.157753 Jun 22 19:41:23.693420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 188/405] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:23 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:24.711190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:24.711819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:24.718336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.718819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:24.719596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.720038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:24.861088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:24.868908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1fad5a6b-79ef-4adf-bf89-b071fc65f6fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1501 microversion: 2.1 time: 0.161656 Jun 22 19:41:24.869477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 218/406] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:24 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:24.885937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d3f03ad-0025-4a9f-8e53-dc05af453991"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:24.887405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:24.889816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=26 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:24.895758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.896227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:24.897010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.897443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:24.924885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] HTTP exception thrown: Cannot 'attach_volume' instance 9ebc14a2-64d9-4c3a-b545-f37268103753 while it is in vm_state rescued Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Request method failure captured: Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/os-volume_attachments HTTP/1.1 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 74 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_Lr8z5JzgjQL9TYHcBPh0MLSB6eIRV-fljd_yD9TeLhhluFJLoUPohhGotgWlb3mXMAGp00Zc_NU44Rhb59-Zhd8UQ6_rgrPjbJhWSNfrPUHEnqvnjRvRNGGcRA5RIoY7P_Cd4aR29ttKB9KtyYXEMtwRE9lcCK-XyS-e-MjjUr0c Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:41:24.926452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8afcbe68ae6d4faea1026898d97882c8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: fe09f44c5fac46799e0d6883004151bf Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {"volumeAttachment": {"volumeId": "4d3f03ad-0025-4a9f-8e53-dc05af453991"}} Jun 22 19:41:24.928078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Cannot 'attach_volume' instance 9ebc14a2-64d9-4c3a-b545-f37268103753 while it is in vm_state rescued Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '9ebc14a2-64d9-4c3a-b545-f37268103753', 'body': {'volumeAttachment': {'volumeId': '4d3f03ad-0025-4a9f-8e53-dc05af453991'}}} Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:41:24.928964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9ebc14a2-64d9-4c3a-b545-f37268103753 while it is in vm_state rescued Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:41:24.930140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9ebc14a2-64d9-4c3a-b545-f37268103753 while it is in vm_state rescued Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Returning 409 to user: Cannot 'attach_volume' instance 9ebc14a2-64d9-4c3a-b545-f37268103753 while it is in vm_state rescued {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-53157e9a-c0b7-4ec7-8723-4caa64bfb992 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046567 Jun 22 19:41:24.931219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 189/407] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:41:24 2022] POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 19:41:24.937333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:24.937855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:24.943943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.944415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:24.945176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:24.945584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:25.014475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7b42a054-0448-490f-9c2b-d51364c4420c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/action" status: 202 len: 0 microversion: 2.1 time: 0.080756 Jun 22 19:41:25.015011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 219/408] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:41:24 2022] POST /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:41:25.023064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:25.023695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:25.029910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:25.030357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:25.031110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:25.031537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:25.217347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:25.226586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c1253060-be46-40fb-b9b5-3e6d0f8966b6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.206850 Jun 22 19:41:25.227599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 190/409] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:25 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:26.243533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:26.244286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:26.250709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:26.251148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:26.251908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:26.252370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:26.427748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:26.436167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fde30777-c03f-40d8-97ae-556949ec6780 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.197029 Jun 22 19:41:26.436738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 220/410] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:26 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:27.453383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:27.453949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:27.460320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:27.460979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:27.461949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:27.462385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:27.598569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:27.606486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-18492bbb-000a-4258-9b9d-da82d54a0d8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.157092 Jun 22 19:41:27.607047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 191/411] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:27 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:28.623523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:28.624160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:28.630654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:28.631098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:28.631878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:28.632326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:28.769257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:28.777432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c7965723-27f6-4afe-a098-4db4ba90b54e tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.158340 Jun 22 19:41:28.778007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 221/412] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:28 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:29.798950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:29.799791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:29.810787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:29.811486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:29.812758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:29.813487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:29.962090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:29.969926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-50042a1e-115f-4b5d-8865-47051f531dfe tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.177711 Jun 22 19:41:29.970465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 192/413] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:29 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:30.986837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:30.987362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:30.993815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:30.994286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:30.995009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:30.995447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:31.144014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:31.151896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-27ee572f-a02b-4fa2-8d6e-fe5da3b63b81 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.168977 Jun 22 19:41:31.152566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 222/414] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:30 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:32.173300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:32.174368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:32.182110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:32.182620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:32.183464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:32.183940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:32.326146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:32.334202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c68f7086-2cc9-4613-b804-66d807935838 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.167415 Jun 22 19:41:32.334775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 193/415] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:32 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:33.355270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:33.356079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:33.366294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:33.367032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:33.368280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:33.369044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:33.373423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:33.507316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:33.518752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-09141b55-e166-43a9-9c4c-5b845fc4b0ce tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.170117 Jun 22 19:41:33.519544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 223/416] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:33 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:34.538818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:34.539609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:34.549982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:34.550432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:34.551194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:34.551627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:34.554261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=88 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:34.691195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:34.702443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e7dab63-bcfc-4f30-a1f7-d9373869fe4b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1509 microversion: 2.1 time: 0.169198 Jun 22 19:41:34.703820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 194/417] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:34 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:35.720602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:35.721276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:35.727949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:35.728464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:35.729453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:35.730074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:35.868051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:35.875636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1290b476-8981-48c0-919d-4db8e6fc623c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1515 microversion: 2.1 time: 0.159092 Jun 22 19:41:35.876226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 224/418] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:35 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:37.232011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d08b2e3-2849-4867-b78b-f55ce294677a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: .version_select at 0x7fdc19e7bdc0>, body: {"keypair": {"name": "tempest-keypair-1320437276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw5UBu38/Zp12nV3T2JIw4XxW5arSD7zML10RQYeOyBhAtrw3e9+xHj7aizdhYjBCBEP6dnq2nAKl9vRWvcwwt7m7NSR0zF3yybWhHsL7XqTT/rvvCyHJeFKV6tXY3yig=="}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:37.246793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-0d08b2e3-2849-4867-b78b-f55ce294677a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:41:37.251015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-0d08b2e3-2849-4867-b78b-f55ce294677a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for user fe09f44c5fac46799e0d6883004151bf and project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:41:37.276293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d08b2e3-2849-4867-b78b-f55ce294677a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046269 Jun 22 19:41:37.276293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 195/419] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:41:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:38.596620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-476467576", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9bac6e6-c16d-4962-b622-645a4fe81c1a"}], "security_groups": [{"name": "tempest-securitygroup--13736273"}], "key_name": "tempest-keypair-1320437276", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:38.703739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] validate_networks() for [('f9bac6e6-c16d-4962-b622-645a4fe81c1a', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:41:39.084648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:41:39.085098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:41:39.085619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:41:39.086045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:41:39.086475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:41:39.095946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:39.096427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:39.097286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:39.097720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:39.116909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:41:39.121037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Getting quotas for user fe09f44c5fac46799e0d6883004151bf and project 8afcbe68ae6d4faea1026898d97882c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:41:39.132560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:41:39.134827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:41:39.189716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d4bb329c-aaf2-4978-9070-04f9a5bccfab tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.597458 Jun 22 19:41:39.190529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 225/420] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:41:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:41:39.201360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dfbe2273-ca24-4481-84ef-aeafc8516df3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:39.202019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dfbe2273-ca24-4481-84ef-aeafc8516df3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:39.258013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dfbe2273-ca24-4481-84ef-aeafc8516df3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:39.265515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dfbe2273-ca24-4481-84ef-aeafc8516df3 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1245 microversion: 2.1 time: 0.068913 Jun 22 19:41:39.266080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 196/421] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:39 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:40.286571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:40.287165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:40.293596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:40.294097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:40.294946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:40.295589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:40.356586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:40.364318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-afb85419-f7f1-468f-ac4d-3f89241cd060 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1249 microversion: 2.1 time: 0.083040 Jun 22 19:41:40.364894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 226/422] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:40 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:41.381660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:41.382285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:41.389325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:41.389774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:41.390548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:41.390986 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:41.454901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:41.463211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2377b3f2-6463-4427-9652-666542e8eeb6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1249 microversion: 2.1 time: 0.085333 Jun 22 19:41:41.463770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 197/423] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:41 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:42.481004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:42.481620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:42.488286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:42.488729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:42.489493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:42.489908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:42.557586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:42.565422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c7ea73a7-2ba1-42b8-bb3d-e7f157db9c07 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1249 microversion: 2.1 time: 0.088326 Jun 22 19:41:42.566025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 227/424] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:42 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:43.581940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:43.582483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:43.589558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:43.590018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:43.590771 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:43.591202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:43.660489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:43.669127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d1bf8fa5-07bc-48f6-950c-93aa832b2cca tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1297 microversion: 2.1 time: 0.091168 Jun 22 19:41:43.669696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 198/425] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:43 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:44.687979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:44.688627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:44.694701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:44.695138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:44.696052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:44.696551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:44.840468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:44.855069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a11607b0-9a64-489a-8761-909e03a4bff0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.170844 Jun 22 19:41:44.866276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 228/426] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:44 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:45.750186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-faebfc22-ac47-4258-848c-ad64274a1d6c req-be59f6f4-1832-4b5e-9497-f88f40bf7360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8bd17a-b43a-4aec-a93f-fb76b65d336e", "tag": "fcd45028-e93b-4996-869d-fb1526d6edb8"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:45.767009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-faebfc22-ac47-4258-848c-ad64274a1d6c req-be59f6f4-1832-4b5e-9497-f88f40bf7360 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:45.767676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-faebfc22-ac47-4258-848c-ad64274a1d6c req-be59f6f4-1832-4b5e-9497-f88f40bf7360 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:45.780593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-faebfc22-ac47-4258-848c-ad64274a1d6c req-be59f6f4-1832-4b5e-9497-f88f40bf7360 service nova] Creating event network-changed:fcd45028-e93b-4996-869d-fb1526d6edb8 for instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e on hv-cinder-84721 Jun 22 19:41:45.787377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-faebfc22-ac47-4258-848c-ad64274a1d6c req-be59f6f4-1832-4b5e-9497-f88f40bf7360 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044815 Jun 22 19:41:45.788344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 199/427] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:45.880012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:45.880763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:45.902745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:45.903176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:45.903967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:45.904434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:46.099756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:46.107849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8fd77db3-8859-4478-a47e-b42a61ac6f62 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.238510 Jun 22 19:41:46.108686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 229/428] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:45 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:47.125540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:47.126293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:47.133396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:47.133848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:47.134604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:47.135034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:47.272275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:47.281687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-57f31269-d0ae-40bf-bbf1-51b5eadf29c2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.160233 Jun 22 19:41:47.282745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 200/429] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:47 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:48.306305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:48.308150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:48.317487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:48.317935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:48.318699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:48.319127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:48.450801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:48.461649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b647feb3-29ae-495c-ba71-d3fd8a979742 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.164855 Jun 22 19:41:48.462233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 230/430] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:48 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:49.478926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:49.479563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:49.482138 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:49.487609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:49.488056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:49.488906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:49.489336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:49.618024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-14374572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1681006282", "security_groups": [{"name": "tempest-secgroup-smoke-1191521017"}], "networks": [{"uuid": "96423ace-cf7a-4dd1-b8a3-119d92b849e7"}], "block_device_mapping_v2": [{"uuid": "42f776ff-0e29-4f44-a2b0-bfc0f94aa79a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:49.628777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:49.629719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:49.630322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:49.638768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-168a1b60-f86f-4c82-905f-e7e9cb4994ff tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.163918 Jun 22 19:41:49.639792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 201/431] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:49 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:49.738136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] validate_networks() for [('96423ace-cf7a-4dd1-b8a3-119d92b849e7', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:41:50.045432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1587003520", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "networks": [{"uuid": "a277d569-eec0-496a-907f-dbef3e537693"}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:50.102591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] validate_networks() for [('a277d569-eec0-496a-907f-dbef3e537693', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:41:50.136341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:41:50.136766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:41:50.137234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:41:50.137632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:41:50.138237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:41:50.141089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:50.147794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.148263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.149436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.149899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.172798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Getting quotas for project 533866da89004b95bb450a4dec134531. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:41:50.177706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Getting quotas for user 18b20561384a4329819a078e44cb82bb and project 533866da89004b95bb450a4dec134531. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:41:50.237926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:41:50.240013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42f776ff-0e29-4f44-a2b0-bfc0f94aa79a',volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:41:50.390284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7215c0fe-b836-4fbd-8d09-b3770adbf4d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775946 Jun 22 19:41:50.391029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 231/432] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:41:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:41:50.400913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-db562b85-150a-441d-8c41-485aac733847 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:50.401764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-db562b85-150a-441d-8c41-485aac733847 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:50.474329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-db562b85-150a-441d-8c41-485aac733847 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:50.482188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-db562b85-150a-441d-8c41-485aac733847 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1087 microversion: 2.1 time: 0.084990 Jun 22 19:41:50.483119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 232/433] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:50.511393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:41:50.511874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:41:50.512723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:41:50.513311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:41:50.513522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:41:50.525170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.525798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.526830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.527573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.546359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Getting quotas for project 5fe1d31b14ef4035ae28d659c0fa7c92. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:41:50.552043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Getting quotas for user 216e06ca9042475b8424a4e8ad7f0ab3 and project 5fe1d31b14ef4035ae28d659c0fa7c92. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:41:50.564004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:41:50.566228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:41:50.615858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6c32fe45-2ffc-4b96-bf6f-bbbe42b7efca tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574260 Jun 22 19:41:50.621636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 202/434] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:41:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 19:41:50.627001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3d6d668a-46aa-4531-965f-f6b0badefaae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:50.634232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3d6d668a-46aa-4531-965f-f6b0badefaae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:50.669656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:50.672403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:50.690272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.690826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.691504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:50.694740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:50.702584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3d6d668a-46aa-4531-965f-f6b0badefaae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:50.710882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3d6d668a-46aa-4531-965f-f6b0badefaae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1219 microversion: 2.1 time: 0.087848 Jun 22 19:41:50.712281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 233/435] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:50 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:50.870182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:50.880029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-70cbfd23-67f8-4e41-9d6a-899d6300e396 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.217271 Jun 22 19:41:50.881242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 203/436] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:50 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:51.499225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:51.500174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:51.508724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.509370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:51.510156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.510591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:51.590172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:51.598380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8edc9bed-4715-428e-b015-ff2fb7342e11 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1185 microversion: 2.1 time: 0.103074 Jun 22 19:41:51.599801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 234/437] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:51.729745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:51.731420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:51.740161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.740637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:51.741590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.742015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:51.801936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:51.809610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6f2f718f-e6a3-44ee-a84f-21a9f4b36e14 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1271 microversion: 2.1 time: 0.084546 Jun 22 19:41:51.810173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 204/438] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:51 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:51.896984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:51.897733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:51.910136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.910559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:51.911533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:51.911995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:52.081760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:52.090390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e845923a-daea-47e1-84db-59e71f92d75a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.197248 Jun 22 19:41:52.091319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 235/439] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:51 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:52.616766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:52.618438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:52.627951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:52.628630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:52.629674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:52.630305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:52.748781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:52.757007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0e4dba42-9248-4678-865a-3c03725b9b9f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1203 microversion: 2.1 time: 0.143943 Jun 22 19:41:52.757688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 205/440] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1203 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:52.826896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:52.827858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:52.834616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:52.835059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:52.835826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:52.836287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:52.904740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:52.913762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6235bc0b-5158-4e74-8319-4210da116e2e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1277 microversion: 2.1 time: 0.090676 Jun 22 19:41:52.914461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 236/441] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:52 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:53.108291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:53.108899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:53.115016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.115461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.116247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.116672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.434557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:53.441948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4bbdb586-f20a-4e87-bccf-50e545fc817f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.337911 Jun 22 19:41:53.442532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 206/442] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:53 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:53.738132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-80c5590d-a42c-470a-80f9-d7ffe521fc74 req-38ee4881-99f8-4f27-a415-80e687ed8016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8bd17a-b43a-4aec-a93f-fb76b65d336e", "name": "network-vif-plugged", "status": "completed", "tag": "fcd45028-e93b-4996-869d-fb1526d6edb8"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:53.752243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-80c5590d-a42c-470a-80f9-d7ffe521fc74 req-38ee4881-99f8-4f27-a415-80e687ed8016 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.753010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-80c5590d-a42c-470a-80f9-d7ffe521fc74 req-38ee4881-99f8-4f27-a415-80e687ed8016 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.770181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-80c5590d-a42c-470a-80f9-d7ffe521fc74 req-38ee4881-99f8-4f27-a415-80e687ed8016 service nova] Creating event network-vif-plugged:fcd45028-e93b-4996-869d-fb1526d6edb8 for instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e on hv-cinder-84721 Jun 22 19:41:53.775214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:53.776567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:53.778785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-80c5590d-a42c-470a-80f9-d7ffe521fc74 req-38ee4881-99f8-4f27-a415-80e687ed8016 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044158 Jun 22 19:41:53.780374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 237/443] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:53.788164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.788435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.789035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.789459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.933445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:53.935076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:53.944016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.945058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:53.946102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:53.946785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:54.141549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:54.145333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:54.149444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a86d8979-3429-4a55-964d-fb0c4e2e1ed6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1271 microversion: 2.1 time: 0.379213 Jun 22 19:41:54.150101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 207/444] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1271 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:54.152695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9976ac72-ba16-4e9c-bb87-c1813e51a1c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.224327 Jun 22 19:41:54.153252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 238/445] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:53 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:54.459156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:54.459767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:54.475544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:54.476451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:54.477278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:54.477863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:54.762532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:54.770478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ee1a93ef-b3b6-4ed7-bdf9-696a538f3fe8 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.315320 Jun 22 19:41:54.771061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 208/446] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:54 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:55.169606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:55.170215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:55.170934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:55.171620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:55.172596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:55.178072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.178458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.178727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.179225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.179335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.179655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.180249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.180796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.315035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:55.322742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2a218de3-35e5-4eb6-952b-a3cd06b03036 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.155694 Jun 22 19:41:55.323317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 239/447] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:55 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:55.442429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-77cfa325-e6d3-4fc8-9800-78cc0076ce78 req-f43a3016-eab9-41ea-818f-3082befd2e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:55.451468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-77cfa325-e6d3-4fc8-9800-78cc0076ce78 req-f43a3016-eab9-41ea-818f-3082befd2e8b service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.452313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-77cfa325-e6d3-4fc8-9800-78cc0076ce78 req-f43a3016-eab9-41ea-818f-3082befd2e8b service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.465785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-77cfa325-e6d3-4fc8-9800-78cc0076ce78 req-f43a3016-eab9-41ea-818f-3082befd2e8b service nova] Creating event network-changed:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:41:55.474784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-77cfa325-e6d3-4fc8-9800-78cc0076ce78 req-f43a3016-eab9-41ea-818f-3082befd2e8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034540 Jun 22 19:41:55.475667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 240/448] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:55.476786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:55.489536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d52a94de-ee2f-40fd-bf27-b0822b7df1d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.323694 Jun 22 19:41:55.495031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 209/449] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:55.792976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:55.794130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:55.804805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.805928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.807181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:55.807927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:55.951472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:55.958944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3b2cc646-86bd-47f6-88ab-a7904025e902 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.173051 Jun 22 19:41:55.959534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 241/450] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:55 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:56.342889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:56.343866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:56.355289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.356068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:56.357321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.358036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:56.491478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:56.501813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-695b4bd8-49ce-4819-8622-b631bbce554a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.165356 Jun 22 19:41:56.502596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 210/451] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:56 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:56.506808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:56.507405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:56.513599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.514040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:56.514786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.515221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:56.645512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:56.653330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3807be43-3eb4-47ee-bf41-dd6a6a72528a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.150290 Jun 22 19:41:56.653904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 242/452] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:56.979229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:56.980233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:56.989120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.989357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:56.990100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:56.990549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.121187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:57.133770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-25645215-1042-4b2c-a0c6-57d36951ab77 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.161008 Jun 22 19:41:57.134628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 211/453] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:56 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:57.491537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-33aed1e5-ceab-4e4b-9470-5bc36c1467d3 req-191fda46-0711-4d87-b3a6-d0e903d54e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42be957b-1878-4d34-8da2-b0c98a90fd55", "tag": "f21c0215-cc96-47c2-96a6-c5e1f3925a82"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:41:57.500149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-33aed1e5-ceab-4e4b-9470-5bc36c1467d3 req-191fda46-0711-4d87-b3a6-d0e903d54e52 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:57.500623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-33aed1e5-ceab-4e4b-9470-5bc36c1467d3 req-191fda46-0711-4d87-b3a6-d0e903d54e52 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.511720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-33aed1e5-ceab-4e4b-9470-5bc36c1467d3 req-191fda46-0711-4d87-b3a6-d0e903d54e52 service nova] Creating event network-changed:f21c0215-cc96-47c2-96a6-c5e1f3925a82 for instance 42be957b-1878-4d34-8da2-b0c98a90fd55 on hv-cinder-84721 Jun 22 19:41:57.516811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-33aed1e5-ceab-4e4b-9470-5bc36c1467d3 req-191fda46-0711-4d87-b3a6-d0e903d54e52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028959 Jun 22 19:41:57.517400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 243/454] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:41:57.519859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:57.520528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:57.526850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:57.527263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.528015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:57.528479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.660787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:57.668806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3a2d8427-9055-40a7-9977-05e8dd3c32a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.154021 Jun 22 19:41:57.669371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 212/455] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:57 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:57.670668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:57.671365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:57.677859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:57.678310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.679062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:57.679498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:57.813177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:57.820859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a9a80bb0-7e9e-4773-94a0-45073716f151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.154349 Jun 22 19:41:57.821397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 244/456] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:41:58.157694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:58.158638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:58.167413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.167979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.168976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.169523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.307955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:58.315724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9e4f55ca-f371-4857-9292-e78c6e796219 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.164530 Jun 22 19:41:58.316282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 213/457] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:58 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:58.690108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:58.690957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:58.701345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.702089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.703381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.704050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.707191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:58.833417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:58.840650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:58.841164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4109f926-2197-42e3-88ad-200c0be8b031 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.157596 Jun 22 19:41:58.841368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:58.841477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 245/458] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:58 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:58.848329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.848869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.849643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:58.850078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:58.852995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:41:58.983207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:58.991223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-67017d0a-f2b9-421f-bd70-2f5b2a7c4b42 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.154440 Jun 22 19:41:58.991789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 214/459] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:59.333972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:59.334560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:59.342381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:59.342894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:59.343744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:59.344300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:59.479902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:41:59.487783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-33e7322f-ee08-4e30-856c-2e4b45c5d19f tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.158515 Jun 22 19:41:59.488399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 246/460] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:59 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:41:59.862023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:41:59.863041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:41:59.874076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:59.874866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:41:59.876087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:41:59.876940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:00.008157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:00.008703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:00.013878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:00.014719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:00.015163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:00.015916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:00.016363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:00.021517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10eceb77-87df-4578-9a01-932402b88272 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.166078 Jun 22 19:42:00.022093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 215/461] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:41:59 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:00.150017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:00.161273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2993160f-6033-4c63-ab5c-554614e1161b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.157097 Jun 22 19:42:00.162072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 247/462] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:00.504449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:00.505219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:00.511897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:00.512343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:00.513107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:00.513547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:00.536825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:00.560463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:00.645194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:00.653643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22c3ec17-3fba-4c30-bb9a-6c3e26931b1a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.153316 Jun 22 19:42:00.654214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 216/463] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:00 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:01.042829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:01.043718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:01.046700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:01.047822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=10 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:01.058053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.059097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.060579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.061298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.183406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:01.184248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:01.191586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:01.194185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.194630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.195407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.195846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.201752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ab5c223-27d4-4b54-8a75-2202cb956f0d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.165135 Jun 22 19:42:01.202113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 248/464] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:01 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:01.330728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:01.338662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a35c7028-8d7c-4832-b98d-be456cf0fc1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.159640 Jun 22 19:42:01.339223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 217/465] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:01.674121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:01.674721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:01.681265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.681717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.682481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:01.682917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:01.823774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:01.831714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-741092c0-e794-4f21-929f-19d9f5dac125 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.164007 Jun 22 19:42:01.832315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 249/466] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:01 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:02.222381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:02.223420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:02.234871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.235605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:02.236697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.237118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:02.356361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:02.356957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:02.363130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.363570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:02.364355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.364787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:02.366828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:02.374643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a92cb357-7d6d-4237-be56-202fbac4df16 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.158711 Jun 22 19:42:02.375251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 218/467] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:02 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:02.500677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:02.508390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9d61bdfb-499c-4409-b1ba-fff6b6746e8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.156041 Jun 22 19:42:02.508941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 250/468] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:02.853583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:02.854576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:02.865215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.865956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:02.867188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:02.867906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:03.016881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:03.024761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-880ad93d-efde-48d6-af8f-15987e107951 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.178360 Jun 22 19:42:03.025310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 219/469] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:02 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:03.395746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:03.396775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:03.406822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:03.407554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:03.408588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:03.409009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:03.529900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:03.530533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:03.537881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:03.538323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:03.539077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:03.539530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:03.546007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:03.553750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6cae4b7e-443c-4de1-9c8a-3ac3d138277f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.164767 Jun 22 19:42:03.554396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 251/470] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:03 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:03.670559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:03.678518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-edc3b913-2c52-4616-b353-efbd3fa9d7fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.152540 Jun 22 19:42:03.679090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 220/471] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:04.045823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:04.047080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:04.057523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.058266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.059581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.060348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.197865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:04.205668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-88d58b79-f51a-4efb-8e4e-d2ec1ab81c46 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.166359 Jun 22 19:42:04.206238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 252/472] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:04 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:04.571481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:04.572112 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:04.578718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.579164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.580070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.580544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.695210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:04.695968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:04.702644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.703086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.703855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:04.704314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:04.842322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:04.850324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-96353da8-d2df-4b54-8ef3-092357c14a85 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.159027 Jun 22 19:42:04.851601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 253/473] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:05.044410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:05.055902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1f2363c5-2364-42ab-acf0-74db5f3cf0d8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.488177 Jun 22 19:42:05.056775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 221/474] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:04 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:05.223533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:05.224294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:05.231639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:05.232085 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:05.232883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:05.233315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:05.374764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:05.384935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5619226d-36df-4391-9533-14e90ba1f67b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1369 microversion: 2.1 time: 0.165598 Jun 22 19:42:05.385752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 254/475] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:05 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:05.867228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:05.867970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:05.874732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:05.875251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:05.876139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:05.876705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.074961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:06.075572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:06.082052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.082517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.083225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.083673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.194354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:06.202389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3f074c42-1766-49d3-a14f-eafafc6d9e54 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.339145 Jun 22 19:42:06.203066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 222/476] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:06.219819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:06.227753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-57edf01b-3079-4bb3-bb57-b07cbd8bcdb9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.156765 Jun 22 19:42:06.228326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 255/477] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:06 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:42:06.402079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:06.402595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:06.408784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.409223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.410027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.410464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.541062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:06.551480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-515a4fe6-04ca-48ec-8fb8-c40f51dab63a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1564 microversion: 2.1 time: 0.153255 Jun 22 19:42:06.552059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 223/478] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:06 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:06.567798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:06.568318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:06.574401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.574852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.575617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:06.576054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:06.656169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a17b00bb-f71b-49f3-8e8b-6585544806eb tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091897 Jun 22 19:42:06.657038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 256/479] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 19:42:06 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:07.219353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:07.219960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:07.228992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:07.229440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:07.230218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:07.230644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:07.244603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:07.245860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:07.253067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:07.253508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:07.254281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:07.254825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:07.376209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:07.384265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ae96d70f-6b58-4dd6-a01e-257eec3fa750 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.169180 Jun 22 19:42:07.384816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 224/480] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:07.486928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:07.495013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b7a5a7e5-e23e-4572-a193-1cacae5ed5df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.254251 Jun 22 19:42:07.495610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 257/481] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:07 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:07.900498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-d9aba7f3-33b6-47c3-8374-371150dd7768 req-dc53b9a4-35fe-4fc4-82c0-1fdbe8fd2f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8bd17a-b43a-4aec-a93f-fb76b65d336e", "tag": "fcd45028-e93b-4996-869d-fb1526d6edb8"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:07.908869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-d9aba7f3-33b6-47c3-8374-371150dd7768 req-dc53b9a4-35fe-4fc4-82c0-1fdbe8fd2f1e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:07.909271 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-d9aba7f3-33b6-47c3-8374-371150dd7768 req-dc53b9a4-35fe-4fc4-82c0-1fdbe8fd2f1e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:07.926521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-d9aba7f3-33b6-47c3-8374-371150dd7768 req-dc53b9a4-35fe-4fc4-82c0-1fdbe8fd2f1e service nova] Creating event network-changed:fcd45028-e93b-4996-869d-fb1526d6edb8 for instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e on hv-cinder-84721 Jun 22 19:42:07.932314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-d9aba7f3-33b6-47c3-8374-371150dd7768 req-dc53b9a4-35fe-4fc4-82c0-1fdbe8fd2f1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035441 Jun 22 19:42:07.933278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 225/482] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:08.401274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:08.401831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:08.408289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:08.408740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:08.409508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:08.409941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:08.511400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:08.512158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:08.519031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:08.519522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:08.520573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:08.521070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:08.543483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:08.551145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b18fca94-9553-4771-b09b-40b33804213b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.153769 Jun 22 19:42:08.551702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 258/483] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:08.650160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:08.658040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fd26255e-4dd4-43eb-9ac3-2796f069e048 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.150828 Jun 22 19:42:08.658670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 226/484] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:08 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:42:09.569599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:09.570242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:09.577439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:09.577909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:09.578683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:09.579114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:09.675939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:09.676592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:09.682768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:09.683301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:09.684178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:09.684669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:09.713734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:09.721565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-596b092c-2071-4f38-b6c4-383ef8f71d66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.156822 Jun 22 19:42:09.722137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 259/485] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:09.818563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:09.826120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8cecc01d-917b-4331-9ad7-fd2a8a05b439 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.155125 Jun 22 19:42:09.826682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 227/486] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:09 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:10.740439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:10.741004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:10.747726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:10.748199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:10.748969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:10.749401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:10.844973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:10.845722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:10.852923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:10.853373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:10.854147 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:10.854576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:10.890372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:10.898276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f02598d6-63a1-455d-a65a-8b68f10f95b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.161803 Jun 22 19:42:10.898948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 260/487] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:10.989440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:10.999298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-53bbb787-a2fe-41a4-8639-18e82ac51d40 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.160100 Jun 22 19:42:10.999795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 228/488] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:10 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:42:11.919889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:11.920919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:11.928344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:11.928787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:11.929537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:11.929956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:12.016469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:12.017304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:12.024717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:12.025161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:12.025903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:12.026330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:12.073484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:12.081319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-831872ad-80d2-4aad-97cd-a2f154fa57cd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.168076 Jun 22 19:42:12.081890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 261/489] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:12.155700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:12.167169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-65a6fb25-d172-43eb-873e-eaa043f217c5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.154416 Jun 22 19:42:12.167915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 229/490] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:12 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:13.102161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:13.103097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:13.113693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:13.114432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:13.115679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:13.116466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:13.120637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:13.186455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:13.187022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:13.194478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:13.194923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:13.195680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:13.196131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:13.257877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:13.266055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4c9089a4-2bac-44a2-9b5d-633573d305f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.170734 Jun 22 19:42:13.266632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 262/491] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:13.334382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:13.341779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ac89b08b-ed63-4362-b3ef-584595962241 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.159240 Jun 22 19:42:13.342340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 230/492] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:13 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:14.286852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:14.288031 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:14.298599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:14.299032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:14.300019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:14.300585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:14.358534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:14.359142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:14.365984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:14.366685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:14.367610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:14.368221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:14.392344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:14.465939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:14.475912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13f5c045-f1c6-4412-a8c3-cd1a90996dd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.194291 Jun 22 19:42:14.485599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 263/493] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:14.523323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:14.531154 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6a3a5650-553f-4329-9e16-2564464f25bf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.176427 Jun 22 19:42:14.531727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 231/494] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:14 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:15.493169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:15.493729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:15.500455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:15.500898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:15.501701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:15.502126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:15.548314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:15.549021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:15.555754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:15.556239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:15.557008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:15.557413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:15.639595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:15.647999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d470c8a6-adcf-4f27-bb42-33c1012e3807 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.158706 Jun 22 19:42:15.648739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 264/495] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:15.688820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:15.696254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f49ae057-d8a0-453e-b34e-98bca6b0ca80 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.151985 Jun 22 19:42:15.696837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 232/496] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:15 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:15.736347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-2b56b3e0-a99c-44a6-9f01-8b70cf5b3523 req-589b7627-7052-4731-a48f-92828bd78167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42be957b-1878-4d34-8da2-b0c98a90fd55", "name": "network-vif-plugged", "status": "completed", "tag": "f21c0215-cc96-47c2-96a6-c5e1f3925a82"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:15.745281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-2b56b3e0-a99c-44a6-9f01-8b70cf5b3523 req-589b7627-7052-4731-a48f-92828bd78167 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:15.745725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-2b56b3e0-a99c-44a6-9f01-8b70cf5b3523 req-589b7627-7052-4731-a48f-92828bd78167 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:15.759105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-2b56b3e0-a99c-44a6-9f01-8b70cf5b3523 req-589b7627-7052-4731-a48f-92828bd78167 service nova] Creating event network-vif-plugged:f21c0215-cc96-47c2-96a6-c5e1f3925a82 for instance 42be957b-1878-4d34-8da2-b0c98a90fd55 on hv-cinder-84721 Jun 22 19:42:15.764689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-2b56b3e0-a99c-44a6-9f01-8b70cf5b3523 req-589b7627-7052-4731-a48f-92828bd78167 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Jun 22 19:42:15.765705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 265/497] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:16.664871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:16.665429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:16.672562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:16.673051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:16.673817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:16.674256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:16.716149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:16.717696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:16.724412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:16.724663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:16.725426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:16.726171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:16.811972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:16.819691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-64d79ab4-0454-483f-b260-521059ee7279 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.158799 Jun 22 19:42:16.820286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 233/498] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:16.857411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:16.865002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a37d56e9-9ce1-4954-a259-4e3f5e5a37a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.155061 Jun 22 19:42:16.865567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 266/499] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:16 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:42:17.841168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:17.841998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:17.849746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:17.850191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:17.851273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:17.851703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:17.881898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:17.882462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:17.888936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:17.889382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:17.890137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:17.890557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:17.992735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:18.000412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1e7dbfd9-90e7-4c33-a9e9-fa46967653f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.166314 Jun 22 19:42:18.001077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 234/500] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:18.028059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:18.038980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-26d8292a-2f76-46fd-9967-b56b12fedf92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1319 microversion: 2.1 time: 0.160748 Jun 22 19:42:18.039655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 267/501] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:17 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:19.021749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:19.022936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:19.029624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:19.030073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:19.031014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:19.031464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:19.064794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:19.065498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:19.072247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:19.072808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:19.073853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:19.074363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:19.184590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:19.193303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-01513622-83e2-4410-b164-70d3b2b2455d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.175444 Jun 22 19:42:19.194129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 235/502] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:19.215953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:19.223714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-04c58984-236a-41a6-8cc0-6d41d05177a1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1507 microversion: 2.1 time: 0.164069 Jun 22 19:42:19.224426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 268/503] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:20.209586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:20.210765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:20.217971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:20.218469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:20.219548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:20.220002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:20.368176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:20.376174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9f15ccc3-6f64-4095-97e2-cf054a3e28c9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.170607 Jun 22 19:42:20.376829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 236/504] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:21.397952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:21.398617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:21.401037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:21.408148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:21.408722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:21.409674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:21.410214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:21.561870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:21.571885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34f513ce-07e2-4498-90a8-50a360ca03a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.179017 Jun 22 19:42:21.572685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 269/505] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:22.589957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:22.590709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:22.599360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:22.600054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:22.601166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:22.601596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:22.741496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:22.749872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e5838f1b-ae7f-4b7b-b9c5-fa713b8b6a79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.163953 Jun 22 19:42:22.750588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 237/506] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:23.767336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:23.767946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:23.774746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:23.775196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:23.775962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:23.776447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:23.909840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:23.917474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52bf01e7-440e-4319-aa4e-a15700b4255f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.154045 Jun 22 19:42:23.918044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 270/507] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:24.938041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:24.938948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:24.947008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:24.947455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:24.948241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:24.948785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:25.087356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:25.095020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5c73d4f3-7e22-40bb-9471-37d771a3ec0e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.163630 Jun 22 19:42:25.095619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 238/508] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:26.012183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-9bf8ce09-ff00-4dcd-9e7f-5a5503b056d6 req-2acb4cf6-2831-43f7-a578-e21af81caa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "name": "network-vif-plugged", "status": "completed", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:26.021253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-9bf8ce09-ff00-4dcd-9e7f-5a5503b056d6 req-2acb4cf6-2831-43f7-a578-e21af81caa39 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:26.021680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-9bf8ce09-ff00-4dcd-9e7f-5a5503b056d6 req-2acb4cf6-2831-43f7-a578-e21af81caa39 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:26.033151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-9bf8ce09-ff00-4dcd-9e7f-5a5503b056d6 req-2acb4cf6-2831-43f7-a578-e21af81caa39 service nova] Creating event network-vif-plugged:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:42:26.038065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-9bf8ce09-ff00-4dcd-9e7f-5a5503b056d6 req-2acb4cf6-2831-43f7-a578-e21af81caa39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029946 Jun 22 19:42:26.039006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 271/509] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:26.112246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:26.112899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:26.115328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=60 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:26.120741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:26.121284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:26.122145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:26.122577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:26.257886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:26.266245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ff237b4c-de45-4c24-8511-f8a567406208 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.157967 Jun 22 19:42:26.267041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 239/510] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:27.283522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:27.284266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:27.290497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:27.290932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:27.291696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:27.292131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:27.490141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:27.511763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-db2c6647-1dde-41c1-b0cd-3516271a1857 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.232475 Jun 22 19:42:27.512696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 272/511] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:28.528867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:28.529496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:28.535811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:28.536331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:28.537189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:28.537625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:28.683000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:28.691256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-81ce3984-ee77-4217-9cf6-5458c7e0d5bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1259 microversion: 2.1 time: 0.166290 Jun 22 19:42:28.691844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 240/512] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:29.708141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:29.708705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:29.714946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:29.715382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:29.716126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:29.716577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:29.856691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:29.864750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6dd45d78-3045-4a03-ba85-4b2998fe67e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1443 microversion: 2.1 time: 0.160618 Jun 22 19:42:29.865314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 273/513] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:29.884409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:29.885178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:29.893520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:29.894110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:29.894891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:29.895447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:30.033494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:30.041314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f9f2b34f-9678-4b89-8b87-cbbf468aec89 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1443 microversion: 2.1 time: 0.161710 Jun 22 19:42:30.041808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 241/514] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:32.148301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-de5f16bb-a5a8-48bb-9d21-e42b156ee63e req-1839d799-abaa-4f13-baad-323f716f5f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:32.157919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-de5f16bb-a5a8-48bb-9d21-e42b156ee63e req-1839d799-abaa-4f13-baad-323f716f5f37 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:32.158599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-de5f16bb-a5a8-48bb-9d21-e42b156ee63e req-1839d799-abaa-4f13-baad-323f716f5f37 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:32.172350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-de5f16bb-a5a8-48bb-9d21-e42b156ee63e req-1839d799-abaa-4f13-baad-323f716f5f37 service nova] Creating event network-changed:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:42:32.177984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-de5f16bb-a5a8-48bb-9d21-e42b156ee63e req-1839d799-abaa-4f13-baad-323f716f5f37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Jun 22 19:42:32.179590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 274/515] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:43.982329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-968560482", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "networks": [{"uuid": "942a4dc5-bf0a-4d0b-8e62-a7fd085ec4de"}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:43.989704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=5 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:43.990370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=63 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:44.042770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] validate_networks() for [('942a4dc5-bf0a-4d0b-8e62-a7fd085ec4de', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:42:44.405463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:42:44.406033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:42:44.406804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:42:44.407411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:42:44.407996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:42:44.423544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:44.424169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:44.425445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:44.426053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:44.445594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Getting quotas for project 2daf1dbea77346099900900d36c8618e. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:42:44.450100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Getting quotas for user a4e7c53907134ea9ba292e87d9f4f35d and project 2daf1dbea77346099900900d36c8618e. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:42:44.461146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:42:44.463520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:42:44.511310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b0b20c7f-1590-4b71-98c3-23b72d599abf tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533455 Jun 22 19:42:44.511999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 242/516] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:42:44.519412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=11 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:44.520291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=65 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:44.524462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-23c26941-a6a3-4649-87b5-10ca1b96df08 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:44.525190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-23c26941-a6a3-4649-87b5-10ca1b96df08 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:44.579298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-23c26941-a6a3-4649-87b5-10ca1b96df08 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:44.586214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-23c26941-a6a3-4649-87b5-10ca1b96df08 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1213 microversion: 2.1 time: 0.067960 Jun 22 19:42:44.586975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 275/517] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:44 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:45.604044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:45.604643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:45.610957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:45.611390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:45.612135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:45.612581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:45.698289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:45.706327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e03c54ff-7693-4ed1-b6f2-e556f610927e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1265 microversion: 2.1 time: 0.107049 Jun 22 19:42:45.706882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 243/518] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:45 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:46.727328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:46.728364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:46.738700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:46.739439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:46.740764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:46.741607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:46.879605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:46.887232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f5f12aed-c2d3-4372-8ee6-54a24d053da3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.166901 Jun 22 19:42:46.887891 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 276/519] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:46 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:47.215719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7f033bd-d8ac-4f5f-a555-01766eea0327", "device": "/dev/sdb"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:47.217399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:47.224355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:47.224818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:47.225928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:47.226359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:47.462206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-6cf161df-f1f4-497c-9b82-a66de13046c2 req-f26cf20d-7fec-4d81-a830-548adac68c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c9517c-4899-40fa-b884-741b6349f184", "tag": "fe99c3a3-00df-4306-b1ee-c6933bc70d51"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:47.470644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-6cf161df-f1f4-497c-9b82-a66de13046c2 req-f26cf20d-7fec-4d81-a830-548adac68c97 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:47.471266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-6cf161df-f1f4-497c-9b82-a66de13046c2 req-f26cf20d-7fec-4d81-a830-548adac68c97 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:47.484234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-6cf161df-f1f4-497c-9b82-a66de13046c2 req-f26cf20d-7fec-4d81-a830-548adac68c97 service nova] Creating event network-changed:fe99c3a3-00df-4306-b1ee-c6933bc70d51 for instance f8c9517c-4899-40fa-b884-741b6349f184 on hv-cinder-84721 Jun 22 19:42:47.489229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-6cf161df-f1f4-497c-9b82-a66de13046c2 req-f26cf20d-7fec-4d81-a830-548adac68c97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Jun 22 19:42:47.489868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 277/520] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:42:47.827079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8e8a28e3-cfad-4dd2-9a6e-cf66a2f12060 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "POST /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615556 Jun 22 19:42:47.827766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 244/521] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:42:47 2022] POST /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:47.904990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:47.906786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:47.914736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:47.915185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:47.915950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:47.916414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:48.048932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:48.056442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13fe3339-e99e-46de-97c6-1f488a54d958 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.155744 Jun 22 19:42:48.057304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 278/522] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:47 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:49.079320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:49.080405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:49.090647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:49.091096 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:49.091854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:49.092323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:49.224257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:49.232463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e72b038b-ced0-40c2-a0a1-8a63e90b04a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.161145 Jun 22 19:42:49.233466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 245/523] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:49 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:50.254600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:50.255522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:50.264529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:50.264974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:50.265691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:50.266387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:50.399630 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:50.407344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3c1b899b-9303-4bf2-bd9b-4529c9539347 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.159285 Jun 22 19:42:50.407896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 279/524] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:50 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:51.426331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:51.427034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:51.435601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:51.436163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:51.437155 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:51.437692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:51.575846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:51.585960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-084f024b-05f0-4755-9b70-274f2f810929 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.164617 Jun 22 19:42:51.586563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 246/525] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:51 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:52.607126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:52.608161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:52.618183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:52.618926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:52.620156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:52.620899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:52.752862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:52.764837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0028ec68-f976-4b88-b499-ba356e115da1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.164177 Jun 22 19:42:52.765681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 280/526] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:52 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:53.791182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:53.792081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:53.800293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:53.800749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:53.801516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:53.801950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:53.935515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:53.946825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7f0de81a-3e6d-442f-8144-70495a4097ca tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.162077 Jun 22 19:42:53.947699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 247/527] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:53 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:54.076413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:54.076982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:54.083171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:54.083618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:54.084432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:54.084864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:54.108445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-40fa22aa-dc01-4463-984e-4430b083f593 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/ips" status: 200 len: 151 microversion: 2.20 time: 0.036047 Jun 22 19:42:54.109015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 281/528] 10.222.0.26 () {60 vars in 1288 bytes} [Wed Jun 22 19:42:54 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:42:54.965230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:54.965796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:54.967872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:54.968677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:54.976196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:54.976648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:54.977415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:54.977849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:55.108959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:55.116972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d16e799e-76ca-4757-88fc-7b677efef1b2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.155704 Jun 22 19:42:55.117541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 248/529] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:54 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:56.137838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:56.138659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:56.140725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:42:56.146380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:56.146822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:56.147576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:56.148003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:56.280070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:56.287609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-72738e02-641f-494f-9b07-df554610b9c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.156317 Jun 22 19:42:56.288193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 282/530] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:56 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:56.595662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-1b5ed492-fa13-4351-924c-657894a027b3 req-a2a82b6f-1e0a-4e28-b681-26d10ccdce4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c9517c-4899-40fa-b884-741b6349f184", "name": "network-vif-plugged", "status": "completed", "tag": "fe99c3a3-00df-4306-b1ee-c6933bc70d51"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:56.605122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1b5ed492-fa13-4351-924c-657894a027b3 req-a2a82b6f-1e0a-4e28-b681-26d10ccdce4d service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:56.605753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1b5ed492-fa13-4351-924c-657894a027b3 req-a2a82b6f-1e0a-4e28-b681-26d10ccdce4d service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:56.618202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-1b5ed492-fa13-4351-924c-657894a027b3 req-a2a82b6f-1e0a-4e28-b681-26d10ccdce4d service nova] Creating event network-vif-plugged:fe99c3a3-00df-4306-b1ee-c6933bc70d51 for instance f8c9517c-4899-40fa-b884-741b6349f184 on hv-cinder-84721 Jun 22 19:42:56.623492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-1b5ed492-fa13-4351-924c-657894a027b3 req-a2a82b6f-1e0a-4e28-b681-26d10ccdce4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Jun 22 19:42:56.624358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 249/531] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:57.034164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:42:57.034697 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:57.041187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.041637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.042400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.042830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.065858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lazy-loading 'flavor' on Instance uuid 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:42:57.305727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:57.306602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:57.313060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.313507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.314263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.314691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.328421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5ea155b5-3454-40b0-8a6f-afcfb17b1f93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/action" status: 202 len: 0 microversion: 2.20 time: 0.297950 Jun 22 19:42:57.329232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 283/532] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jun 22 19:42:57 2022] POST /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:42:57.338302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:57.338994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:57.345394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.345831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.346598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:57.347035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:57.451480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:57.459181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37bf0f19-ed4a-430e-808f-f2a0cf851afd tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.158399 Jun 22 19:42:57.459935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 250/533] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:57 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:42:57.482531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:57.490392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:57.491876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:57.493052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-39f5b4b3-62b1-435b-8ace-e9169b81e5a5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.159186 Jun 22 19:42:57.493611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 284/534] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:42:57 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:42:58.476025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:58.476669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:58.483830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:58.484317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:58.485084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:58.485515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:58.510678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:58.511286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:58.517853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:58.518299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:58.519058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:58.519484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:58.617177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:58.624810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-43c58cb2-1da0-43d6-b20b-a2e21e53e67a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1313 microversion: 2.1 time: 0.152980 Jun 22 19:42:58.625470 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 251/535] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:58 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:58.650601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:58.658928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:58.660494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:58.661646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4549dec-99af-4fa7-b918-1142020af007 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.154798 Jun 22 19:42:58.662202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 285/536] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:42:58 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:42:59.643390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:59.644450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:59.652798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.653244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.654051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.654481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.680071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:59.680673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:59.687048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.687494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.688297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.688743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.789339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:59.797040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-70746da0-7ee0-494a-b9ef-7488700e1186 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1497 microversion: 2.1 time: 0.158271 Jun 22 19:42:59.797613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 252/537] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:42:59 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:42:59.802300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:42:59.802523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:42:59.808310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.808754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.809512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:42:59.810004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:42:59.829034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:59.834675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2a41d97e-5925-46a9-bf87-3d39191306d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/ips" status: 200 len: 145 microversion: 2.1 time: 0.036043 Jun 22 19:42:59.835452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 253/538] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 19:42:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:42:59.838051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:59.839563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:42:59.840870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f9c56e14-769c-4d06-a40e-a59886ea4b47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.164882 Jun 22 19:42:59.841455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 286/539] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:42:59 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:00.499966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:00.500499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:00.506811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.507257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:00.508017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.508482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:00.532972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:43:00.614785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ceb0d8d2-ddd8-4816-a3c9-8ec45099bed3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 204 len: 0 microversion: 2.1 time: 0.118320 Jun 22 19:43:00.615610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 254/540] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:43:00 2022] DELETE /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:43:00.625651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:00.626646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:00.635754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.636426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:00.637559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.638220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:00.777669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:00.785716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-68a63272-b12d-4bee-9304-05f0a369826b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1503 microversion: 2.1 time: 0.165484 Jun 22 19:43:00.786275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 287/541] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:00 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:00.864082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:00.865217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:00.874894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.875342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:00.876130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:00.876560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:01.020876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:01.029567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:01.031077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:01.032287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f1d776f6-8e04-4ad6-959f-dc354e467d16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.175384 Jun 22 19:43:01.032854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 255/542] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:00 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:01.406892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:01.407427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:01.414448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:01.414941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:01.415780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:01.416297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:01.439947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-589329eb-3cbd-488f-8836-47305ae9fb64 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/ips" status: 200 len: 148 microversion: 2.1 time: 0.037329 Jun 22 19:43:01.440544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 288/543] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 19:43:01 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:01.802464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:01.803065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:01.809606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:01.810144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:01.810892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:01.811315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:01.944053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:01.952056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f331e9cc-1c74-4046-8dec-59da7b358a46 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1503 microversion: 2.1 time: 0.153493 Jun 22 19:43:01.952630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 256/544] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:01 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:02.054790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:02.055775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:02.066241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:02.066969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:02.068269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:02.068972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:02.201491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:02.209994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:02.211467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:02.212660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2732e85e-b462-4726-a8f2-b7b37a149b64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.164340 Jun 22 19:43:02.213219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 289/545] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:02 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:02.969207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:02.969796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:02.977541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:02.977989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:02.978741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:02.979165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:02.983406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:03.116049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:03.124400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4a4a6b7e-b6f8-4df9-a335-370eed881b1d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1503 microversion: 2.1 time: 0.158822 Jun 22 19:43:03.125373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 257/546] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:02 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:03.237654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:03.238258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:03.245111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.245554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:03.246314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.246727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:03.385633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:03.394010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:03.395505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:03.396695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a898ff40-cd04-4932-8d02-a16d3e69b50f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.163121 Jun 22 19:43:03.397237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 290/547] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:03 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:03.844991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47a885ec-402d-43ac-81c0-dd2ecb968b83"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:03.846137 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:03.854661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.855102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:03.855835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.856965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:03.909342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac867974-959d-4d72-a985-1029da495549"}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:03.910669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:03.916729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.917128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:03.918033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:03.918605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.011642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:04.200786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c9ec66ee-9cde-4091-89bd-bfd9c24b9c70 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359509 Jun 22 19:43:04.202244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 258/548] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:43:03 2022] POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:04.228770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:04.229861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:04.243976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:04.246371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.247875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:04.248627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.323207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:04.333295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7cd55217-954e-4bed-ba70-7e24b5191042 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428014 Jun 22 19:43:04.333854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5eacbc23-a981-42a8-a5bc-fa0bf89607a6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1461 microversion: 2.1 time: 0.129255 Jun 22 19:43:04.334314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 259/549] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:04 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1461 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:04.334545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 291/550] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:43:03 2022] POST /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:04.339516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-1f292e61-a399-4e9c-a481-5e5d7715d445 req-e0b6e992-c70d-43ae-85d2-d2dac6cb64c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c9517c-4899-40fa-b884-741b6349f184", "name": "network-vif-deleted", "tag": "fe99c3a3-00df-4306-b1ee-c6933bc70d51"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:04.351077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1f292e61-a399-4e9c-a481-5e5d7715d445 req-e0b6e992-c70d-43ae-85d2-d2dac6cb64c3 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:04.351739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1f292e61-a399-4e9c-a481-5e5d7715d445 req-e0b6e992-c70d-43ae-85d2-d2dac6cb64c3 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.366851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-1f292e61-a399-4e9c-a481-5e5d7715d445 req-e0b6e992-c70d-43ae-85d2-d2dac6cb64c3 service nova] Creating event network-vif-deleted:fe99c3a3-00df-4306-b1ee-c6933bc70d51 for instance f8c9517c-4899-40fa-b884-741b6349f184 on hv-cinder-84721 Jun 22 19:43:04.371982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-1f292e61-a399-4e9c-a481-5e5d7715d445 req-e0b6e992-c70d-43ae-85d2-d2dac6cb64c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Jun 22 19:43:04.372796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 260/551] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:04.416970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:04.417587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:04.425677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:04.426159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.427136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:04.427682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:04.567180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:04.575057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:04.577132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:04.578289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0bbb5d3b-1941-4993-802f-7a62ee00620d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.166065 Jun 22 19:43:04.578846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 292/552] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:04 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:05.352582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:05.353205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:05.359581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:05.360026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:05.360817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:05.361275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:05.392980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:05.393433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:05.393873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lazy-loading 'fault' on Instance uuid f8c9517c-4899-40fa-b884-741b6349f184 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:43:05.437432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:05.445669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-844b71c1-5854-4739-855e-2381b29564ce tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1303 microversion: 2.1 time: 0.098407 Jun 22 19:43:05.446236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 261/553] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:05 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:05.601077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:05.602239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:05.611045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:05.611456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:05.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:05.612677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:05.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:05.768985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:05.770494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:05.771661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-64480442-5b0e-4bd2-945b-b54a85685569 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.177437 Jun 22 19:43:05.772261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 293/554] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:05 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:06.467845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:06.468882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:06.480283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:06.481202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:06.483223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:06.483456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:06.516435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:06.516880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:06.517320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lazy-loading 'fault' on Instance uuid f8c9517c-4899-40fa-b884-741b6349f184 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:43:06.559501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:06.566942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f2f67d92-ca8d-4229-b7f3-ec89096a67e0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 200 len: 1303 microversion: 2.1 time: 0.105855 Jun 22 19:43:06.567686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 262/555] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:06 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:06.793852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:06.794835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:06.805873 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:06.806605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:06.807840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:06.808610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:06.958900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:06.966881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:06.968656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:06.969833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d4282330-abbf-40f8-9010-a1936ca5379e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.182476 Jun 22 19:43:06.970383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 294/556] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:06 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:07.583859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:07.584527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: f8c9517c-4899-40fa-b884-741b6349f184] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:07.591166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:07.591615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:07.592493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:07.592956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:07.606632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] HTTP exception thrown: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Request method failure captured: Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 HTTP/1.1 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3CxMDTIopbYpiLZCeT0xmit6SNGcqaaB2CHGUQlU69A_O_o9P58JiVaOe8Xu0QL6MJHljhA1W4aoI9gImVjVXW_DtgDZ0geM0ozDCxOnqDIX4-9nn5GljwNnk0GrkcuwzVW9dfan7nQdczfC9qh7wVUAw98ykG7y2ejwL8iL3Jrg94 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 2daf1dbea77346099900900d36c8618e Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesActionsTest-1776622320 Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:43:07.608278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2daf1dbea77346099900900d36c8618e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2daf1dbea77346099900900d36c8618e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2daf1dbea77346099900900d36c8618e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2daf1dbea77346099900900d36c8618e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesActionsTest-1776622320 Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 2daf1dbea77346099900900d36c8618e Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesActionsTest-1776622320 Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesActionsTest-1776622320-project Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: a4e7c53907134ea9ba292e87d9f4f35d Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesActionsTest-1776622320-project Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. Jun 22 19:43:07.609842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'f8c9517c-4899-40fa-b884-741b6349f184'} Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:43:07.610752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. Jun 22 19:43:07.612248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:43:07.613520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Returning 404 to user: Instance f8c9517c-4899-40fa-b884-741b6349f184 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:43:07.613520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ceb709cb-7419-433c-9254-112b7964b48c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184" status: 404 len: 111 microversion: 2.1 time: 0.029642 Jun 22 19:43:07.613520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 263/557] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:07 2022] GET /compute/v2.1/servers/f8c9517c-4899-40fa-b884-741b6349f184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:43:07.721068 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-994850989", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "networks": [{"uuid": "942a4dc5-bf0a-4d0b-8e62-a7fd085ec4de"}]}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:07.775825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] validate_networks() for [('942a4dc5-bf0a-4d0b-8e62-a7fd085ec4de', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:43:07.988898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:07.989424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:07.997906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:07.998552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:07.999673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:08.000332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:08.134787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:08.134998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:43:08.135455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:43:08.135838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:43:08.136269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:43:08.136711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:43:08.142865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:08.144359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:08.145507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ad2bdd9-2996-4e07-9de5-33ba2f0206ca tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.160668 Jun 22 19:43:08.146057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 264/558] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:07 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:08.147464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:08.148173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:08.149482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:08.150160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:08.168378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Getting quotas for project 2daf1dbea77346099900900d36c8618e. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:43:08.172378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Getting quotas for user a4e7c53907134ea9ba292e87d9f4f35d and project 2daf1dbea77346099900900d36c8618e. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:43:08.183223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:43:08.185530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:43:08.231696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb692ad9-d110-4884-85cd-70555b5950f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514876 Jun 22 19:43:08.232446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 295/559] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:43:08.242593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a3a72b7b-7a5c-4073-8356-cec2c242275a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:08.243122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a3a72b7b-7a5c-4073-8356-cec2c242275a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:08.294096 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a3a72b7b-7a5c-4073-8356-cec2c242275a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:08.301163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a3a72b7b-7a5c-4073-8356-cec2c242275a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1213 microversion: 2.1 time: 0.062340 Jun 22 19:43:08.301922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 265/560] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:08 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:09.163525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:09.164060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:09.171253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:09.171695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:09.172489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:09.172913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:09.318499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:09.319720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:09.325592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:09.328815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:09.329814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:09.330930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:09.331515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:09.336459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:09.338193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:09.339887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af9e29fe-c677-4b86-957b-35c796fa191b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.180220 Jun 22 19:43:09.351747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 296/561] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:09 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:09.405637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:09.414315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6e759d11-e0d9-4947-9709-df3f7342a4aa tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1265 microversion: 2.1 time: 0.099544 Jun 22 19:43:09.414900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 266/562] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:09 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:43:10.359695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:10.360348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:10.367152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:10.367598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:10.368490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:10.368852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:10.431504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:10.432366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:10.439596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:10.440042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:10.446165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:10.446790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:10.518767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:10.526970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:10.528527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:10.529970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4105384-0c29-4dcb-b769-d908a25b0d7c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.174774 Jun 22 19:43:10.530525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 297/563] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:10 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:43:10.675709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:10.683772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a53a6215-c40b-4da7-9b9d-b156ce7dc0c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.256281 Jun 22 19:43:10.684638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 267/564] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:10 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:11.014376 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-4749e51a-32ff-4aae-b092-2ad36fddc4d0 req-bc21bd8f-7c0d-4d9f-bd94-959940fde563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db34ecf0-0253-4fcd-9ad7-45e29ebaeff1", "tag": "ed261e9e-6ed3-496c-88bc-d75e33074bda"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:11.038339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-4749e51a-32ff-4aae-b092-2ad36fddc4d0 req-bc21bd8f-7c0d-4d9f-bd94-959940fde563 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:11.038781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-4749e51a-32ff-4aae-b092-2ad36fddc4d0 req-bc21bd8f-7c0d-4d9f-bd94-959940fde563 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:11.050134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-4749e51a-32ff-4aae-b092-2ad36fddc4d0 req-bc21bd8f-7c0d-4d9f-bd94-959940fde563 service nova] Creating event network-changed:ed261e9e-6ed3-496c-88bc-d75e33074bda for instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 on hv-cinder-84721 Jun 22 19:43:11.055035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-4749e51a-32ff-4aae-b092-2ad36fddc4d0 req-bc21bd8f-7c0d-4d9f-bd94-959940fde563 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044720 Jun 22 19:43:11.055681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 298/565] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:11.548685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:11.549237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:11.556235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:11.556687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:11.557445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:11.557880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:11.690923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:11.699338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:11.701259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:11.702499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9a067864-e509-4c0d-9cc9-f328b1023a1e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.157848 Jun 22 19:43:11.703073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 268/566] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:11 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:11.703196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:11.703946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:11.712893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:11.713388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:11.714237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:11.714728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:11.857735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:11.865454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-051c2ff7-54a3-43c7-bd73-de8c05437606 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.168489 Jun 22 19:43:11.866002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 299/567] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:11 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:43:12.722750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:12.723442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:12.730666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:12.731103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:12.731852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:12.732301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:12.865843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:12.874438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:12.875936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:12.877209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-28a657d8-2c5c-4b34-bd1f-e05c897ffbb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.158323 Jun 22 19:43:12.877760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 269/568] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:12 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:12.882233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:12.882816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:12.889573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:12.890019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:12.890769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:12.891196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:13.024436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:13.032218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cecaafeb-7be7-4a10-82fa-d27fad27449c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.153714 Jun 22 19:43:13.032783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 300/569] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:12 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:13.895310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:13.895913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:13.902920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:13.903629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:13.904198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:13.904616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:14.036007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:14.044087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:14.045686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:14.046838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7cf649fe-3e6b-4606-af6b-011d43fec5c6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.155407 Jun 22 19:43:14.047405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 270/570] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:13 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:14.048406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:14.049011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:14.055761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:14.056247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:14.056997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:14.057441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:14.187238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:14.196131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6448e3bc-ebd6-4181-83c2-cb8384511f41 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.151653 Jun 22 19:43:14.196707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 301/571] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:14 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:43:15.066717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:15.067717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:15.070546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:15.076587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:15.077178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:15.078355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:15.079056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:15.213437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:15.214034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:15.214175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:15.216451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:15.222595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:15.222784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:15.223251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:15.224028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:15.224160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:15.224489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:15.225551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c6edbd73-9f2e-4d33-9c63-c9dd8739a326 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.163029 Jun 22 19:43:15.226102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 271/572] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:15 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:15.363886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:15.371861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0541fb30-284b-4db2-b88b-8889d0728691 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.162283 Jun 22 19:43:15.372480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 302/573] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:15 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:16.247570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:16.248573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:16.259799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:16.260613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:16.261887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:16.262602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:16.390491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:16.391108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:16.399298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:16.400050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:16.401065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:16.401468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:16.404747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:16.417026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:16.418517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:16.419951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6fef3406-e79c-47a2-9862-5a0f88efbb54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.178894 Jun 22 19:43:16.420581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 272/574] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:16 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:16.540757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:16.548776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-74f5ca6d-517d-4be9-af57-1e4e7770d238 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.163424 Jun 22 19:43:16.549592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 303/575] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:16 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:17.442649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:17.443700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:17.454777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:17.455523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:17.456827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:17.457542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:17.566814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:17.567448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:17.574024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:17.574472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:17.575235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:17.575705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:17.593493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:17.602111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:17.603885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:17.605059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0c60dabc-24eb-4d07-adef-61e1073bd390 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.169268 Jun 22 19:43:17.605588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 273/576] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:17 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:17.707563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:17.715329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0d2f7493-9488-4359-8ac0-6626a8d4e7ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.153107 Jun 22 19:43:17.715890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 304/577] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:17 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:17.882825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-2e51998d-6898-4eb9-bfe0-5621ad8d1dbb req-89f61877-fc69-4551-8684-73baab85f0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db34ecf0-0253-4fcd-9ad7-45e29ebaeff1", "name": "network-vif-plugged", "status": "completed", "tag": "ed261e9e-6ed3-496c-88bc-d75e33074bda"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:43:17.891526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-2e51998d-6898-4eb9-bfe0-5621ad8d1dbb req-89f61877-fc69-4551-8684-73baab85f0cf service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:17.891965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-2e51998d-6898-4eb9-bfe0-5621ad8d1dbb req-89f61877-fc69-4551-8684-73baab85f0cf service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:17.896008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:17.904162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-2e51998d-6898-4eb9-bfe0-5621ad8d1dbb req-89f61877-fc69-4551-8684-73baab85f0cf service nova] Creating event network-vif-plugged:ed261e9e-6ed3-496c-88bc-d75e33074bda for instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 on hv-cinder-84721 Jun 22 19:43:17.909209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-2e51998d-6898-4eb9-bfe0-5621ad8d1dbb req-89f61877-fc69-4551-8684-73baab85f0cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030049 Jun 22 19:43:17.910058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 274/578] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:43:18.624975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:18.625659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:18.627572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:18.628499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:18.637359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:18.637878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:18.639041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:18.639543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:18.730528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:18.736372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:18.737102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:18.751321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:18.751800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:18.752574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:18.753003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:18.781454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:18.789716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:18.791216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:18.792406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-441e40be-3b57-487e-8a10-f0d91d997970 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.172710 Jun 22 19:43:18.792967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 305/579] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:18 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:18.884455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:18.892208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f9b4361c-5cb4-4888-b3fd-5c3f1cc86ea6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.163733 Jun 22 19:43:18.892774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 275/580] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:18 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:19.813306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:19.813860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:19.820923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:19.821371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:19.822137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:19.822564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:19.908720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:19.909292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:19.916396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:19.916835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:19.917587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:19.918009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:19.950978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:19.959522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:19.961180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:19.962409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-05a3ddfb-9bd1-47a7-a106-621091476295 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.154311 Jun 22 19:43:19.963026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 306/581] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:19 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:20.046079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:20.053840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2c254764-050c-42e7-863c-cf6194c2e47a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.148903 Jun 22 19:43:20.054380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 276/582] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:19 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:20.985091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:20.986067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:20.996890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:20.997618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:20.998767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:20.999161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:21.072899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:21.073455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:21.083532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:21.084143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:21.085505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:21.085610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:21.140841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:21.149019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:21.150607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:21.151772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e55663bc-3de9-46ca-a462-be4fb690ab12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.173345 Jun 22 19:43:21.152361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 307/583] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:20 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:21.217451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:21.225693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-956895fd-ab7b-4908-ba5e-1f40ed0501c3 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.158655 Jun 22 19:43:21.226436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 277/584] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:21 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:22.173938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:22.174785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:22.185940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:22.186419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:22.187189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:22.187623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:22.207387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:22.242654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:22.243283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:22.249980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:22.250432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:22.251197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:22.251617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:22.327430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:22.335505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:22.337158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:22.338315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-25d42507-305b-41fc-bb19-fb500bd390c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.171102 Jun 22 19:43:22.339106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 308/585] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:22 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:22.385152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:22.393159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-070fba97-eaa4-4bb9-a1e0-8f9f24506808 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.154368 Jun 22 19:43:22.393914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 278/586] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:22 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:23.356920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:23.357638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:23.364464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:23.364909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:23.365661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:23.366090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:23.414003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:23.414634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:23.426333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:23.426772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:23.427522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:23.428317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:23.514526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:23.522686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:23.524211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:23.525375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bdc92570-c97b-4892-b20f-550f3dc73280 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.172351 Jun 22 19:43:23.525932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 309/587] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:23 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:23.561998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:23.571683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8026effb-5bbc-47b7-8e53-01984a9ddb3d tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.162369 Jun 22 19:43:23.572284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 279/588] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:23 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:24.543480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:24.544058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:24.550757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:24.551193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:24.551947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:24.552401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:24.588431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:24.589009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:24.595890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:24.596387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:24.597157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:24.597593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:24.688954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:24.697146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:24.698635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:24.699787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1b12006a-25b5-4709-940b-cc8c7fe1729c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.160217 Jun 22 19:43:24.700345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 310/589] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:24 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:24.729358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:24.737163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d651149-4fe7-41af-86ec-6f0265850a99 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.152529 Jun 22 19:43:24.737731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 280/590] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:24 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:25.721537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:25.722461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:25.733256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:25.733698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:25.734462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:25.734892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:25.753819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:25.754582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:25.761347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:25.761787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:25.762533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:25.762954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:25.868629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:25.877355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:25.878948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:25.880205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8a172bfe-f799-4dce-89d3-5c26990e2c6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.165050 Jun 22 19:43:25.880842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 311/591] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:25 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:25.895116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:25.905854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aec0c821-3624-44ef-aecf-02bce321a6cb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.155892 Jun 22 19:43:25.906413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 281/592] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:25 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:26.902727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:26.903615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:26.911483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:26.911983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:26.912868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:26.913356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:26.922657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:26.923326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:26.930859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:26.931354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:26.932237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:26.932714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:27.044465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:27.052521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:27.053999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:27.055140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1b705ce6-1197-4d68-8031-7bbc30e8ef0c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.159069 Jun 22 19:43:27.055676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 312/593] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:26 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:27.063624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:27.071167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8977b20f-9584-45ef-abaf-8e398e3837a9 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.152778 Jun 22 19:43:27.071716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 282/594] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:26 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:28.073852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:28.074521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:28.081572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:28.082021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:28.082780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:28.083210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:28.087995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:28.088607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:28.095543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:28.095983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:28.096764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:28.097191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:28.219396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:28.227821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:28.229322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:28.230466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-05885e78-7cd4-4681-a06f-f7a8fd6f8723 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.160942 Jun 22 19:43:28.231034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 313/595] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:28 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:28.233308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:28.240935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f4eeffd0-9aaa-4ead-99bf-5b46314821ad tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.156805 Jun 22 19:43:28.241498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 283/596] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:28 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:29.252986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:29.253973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:29.262429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:29.263609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:29.264704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:29.265435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:29.266679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:29.267412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:29.274634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:29.275370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:29.276683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:29.277397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:29.404695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:29.406501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:29.412878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:29.414049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-62a0de6f-75c4-41e0-a1f9-37c6c4ff8f60 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.158690 Jun 22 19:43:29.414475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:29.414895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 284/597] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:29 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:29.415780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-676b5eb0-b7bb-449d-bbce-9d1b22e80e0a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.169427 Jun 22 19:43:29.416374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 314/598] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:29 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:30.435223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:30.435952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:30.436783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:30.437361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:30.442880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:30.443316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:30.444067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:30.444223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:30.444511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:30.444675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:30.445343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:30.445781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:30.574149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:30.578070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:30.582484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:30.583997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:30.585185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-20e74f57-4371-4c24-b253-1bb393090b20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.154307 Jun 22 19:43:30.585558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e37f7b83-e06f-4958-8144-3807477b52a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.156958 Jun 22 19:43:30.585747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 315/599] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:30 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:30.586144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 285/600] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:30 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:31.608076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:31.608670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:31.609082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:31.609275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:31.615679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:31.616220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:31.616388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:31.616897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:31.617017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:31.617463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:31.617663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:31.618093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:31.745706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:31.748807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:31.754605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:31.756165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:31.756377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0a273c1-c12f-4761-a3f0-3f600f1b4f74 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.155342 Jun 22 19:43:31.757173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 316/601] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:31 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:31.757334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-77d35afa-2862-4c37-a4bd-65b6ccf2866b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.156250 Jun 22 19:43:31.758002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 286/602] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:31 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:32.778365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:32.779292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:32.779399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:32.780017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:32.786364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:32.786770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:32.786926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:32.787211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:32.787556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:32.787958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:32.788127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:32.788416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:32.920977 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:32.921478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:32.928902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9fe12528-3d0f-4c79-bd9c-5e0c279c617c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.157532 Jun 22 19:43:32.929210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:32.929464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 317/603] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:32 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:32.930691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:32.931811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a1a914dd-4b66-42ef-98af-4b3f8328b64b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.158793 Jun 22 19:43:32.932398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 287/604] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:32 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:33.949539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:33.950526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:33.952978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:33.953568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:33.957361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:33.957817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:33.958600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:33.959128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:33.961321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:33.961871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:33.962646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:33.963091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:34.096837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:34.098694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:34.106507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-05b4d94b-5f93-4c0e-87c6-2d0f5e23d851 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.163258 Jun 22 19:43:34.106682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:34.107289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 318/605] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:33 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:34.108142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:34.109513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-77f7757e-d1d9-4a94-9483-796d70bd8e09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.162560 Jun 22 19:43:34.110054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 288/606] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:33 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:35.123894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:35.124557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:35.126752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:35.127873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:35.131799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:35.132279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:35.133039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:35.133424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:35.134473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:35.134889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:35.135628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:35.136047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:35.404011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:35.410000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:35.411529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2d466bf4-7383-4bf7-a8dc-64a54cc718d4 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.292025 Jun 22 19:43:35.412077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 319/607] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:35 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:35.418090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:35.419682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:35.420856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8f09c5a7-f833-4a4c-a1be-5c02dba66f6b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.298053 Jun 22 19:43:35.421418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 289/608] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:35 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:36.432252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:36.433448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:36.440016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:36.440653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:36.441090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:36.441537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:36.442306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:36.442738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:36.447491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:36.447947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:36.448723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:36.449159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:36.574719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:36.582384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8a7cbb52-be5b-46ee-8bae-5afbddd06dd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.156497 Jun 22 19:43:36.582768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:36.583130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 320/609] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:36 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:36.590882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:36.592488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:36.593633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3e3a3552-1a08-43a4-b2e5-6af4054df2d0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.157568 Jun 22 19:43:36.594178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 290/610] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:36 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:37.599420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:37.600386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:37.607286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:37.607728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:37.608514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:37.608935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:37.610783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:37.611513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:37.618354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:37.618800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:37.619554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:37.619978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:37.638459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:37.743187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:37.750982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:37.751175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1edd43da-dff7-4edc-807b-630d2ecf7a7e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.155602 Jun 22 19:43:37.751736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 321/611] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:37 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:37.759046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:37.760565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:37.761770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24b69846-4d5d-4c06-bb70-662c1258c7c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.155004 Jun 22 19:43:37.762316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 291/612] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:37 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:38.771550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:38.772472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:38.780681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:38.781182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:38.781182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:38.781359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:38.781900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:38.782330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:38.787896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:38.788375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:38.789134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:38.789728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:38.912156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:38.920328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f20d126b-03ee-40a1-93fb-fe8d4994acb0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.154865 Jun 22 19:43:38.920901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 322/613] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:38 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:38.921365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:38.929482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:38.930978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:38.932142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b14338ed-c40e-4776-a79a-8e930997e90d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.155964 Jun 22 19:43:38.932692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 292/614] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:38 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:39.942087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:39.943148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:39.953104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:39.953297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:39.953715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:39.953814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:39.954329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:39.954764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:39.960817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:39.961263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:39.962054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:39.962464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:40.085839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:40.092072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:40.093370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0c72bf81-640c-48b8-a7d8-51c0f5f886fe tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.157901 Jun 22 19:43:40.094051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 323/615] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:39 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:40.100353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:40.101829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:40.102967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2c393280-5e7c-45d7-b0ca-b718da7ccae1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.155144 Jun 22 19:43:40.103543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 293/616] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:39 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:41.114709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:41.115748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:41.124037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:41.124659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:41.125183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:41.125638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:41.126404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:41.126836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:41.131379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:41.131823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:41.132610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:41.133017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:41.256254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:41.263661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fce56a27-3958-48eb-91cf-8efe09c3cfb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.155539 Jun 22 19:43:41.266072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 324/617] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:41 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:41.266205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:41.273252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:41.274777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:41.275926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-33263191-35b9-460e-b208-1596b4e9413e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.157651 Jun 22 19:43:41.276507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 294/618] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:41 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:42.284287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:42.285080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:42.294151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:42.294746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:42.295521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:42.295948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:42.296819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:42.297425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:42.301265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:42.304125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:42.304612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:42.305370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:42.305797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:42.434420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:42.442766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fa6f364b-7e4b-413b-af07-5e0a45021cd1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.164709 Jun 22 19:43:42.443550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 325/619] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:42 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:42.450532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:42.458825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:42.460345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:42.461498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-852e689f-3b3c-4043-a183-7d592880cc7f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.169281 Jun 22 19:43:42.462162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 295/620] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:42 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:43.463192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:43.464034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:43.471893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:43.472381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:43.473164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:43.473540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:43.479328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:43.479932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:43.486820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:43.487228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:43.487993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:43.488457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:43.638952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:43.647583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:43.649151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:43.650328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a231201f-2dd2-4f71-9127-ea68da4ffb51 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.175366 Jun 22 19:43:43.650901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 296/621] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:43 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:43.848058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:43.855924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-864a5516-3291-4096-8bf3-3dffb02a35c0 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.398835 Jun 22 19:43:43.856531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 326/622] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:43 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:44.321702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:43:44.322083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:43:44.777954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:44.778588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:44.786688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:44.787954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:44.789996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:44.790997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:44.873077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:44.873637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:44.882907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:44.883382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:44.884152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:44.884589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:44.933818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:44.942112 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:44.943685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:44.944873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3454678b-94c1-4615-baf4-993ed181bf64 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.279436 Jun 22 19:43:44.945442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 297/623] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:44 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:45.012169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:45.023591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a949083d-4a8f-495e-8bbd-3840b464a12a tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.154336 Jun 22 19:43:45.024478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 327/624] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:44 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:45.967168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:45.968147 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:45.971801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=54 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:45.981405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:45.982111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:45.982878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:45.983312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:46.042326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:46.043032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:46.045332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=52 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:46.050952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:46.051404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:46.052206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:46.052644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:46.116731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:46.125198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:46.127512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:46.128890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b9a2718d-ab2a-4041-b511-037ef9ef49c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.167195 Jun 22 19:43:46.128890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 298/625] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:45 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:46.186381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:46.194118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4c1be9e0-5080-4cf2-a7b2-7181ac679760 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.155705 Jun 22 19:43:46.194686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 328/626] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:46 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:43:46.738757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:43:46.738909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:43:47.150724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:47.151759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:47.159949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:47.160453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:47.161250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:47.161703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:47.211029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:47.211709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:47.218396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:47.218840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:47.219588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:47.220013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:47.301009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:47.310117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:47.311662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:47.312950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dc4c5e6c-2711-4f18-9472-ed64dc22770c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.168899 Jun 22 19:43:47.313514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 299/627] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:47 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:47.352527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:47.360143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9a19b83c-2887-4b74-88eb-01aff75e23d1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.152973 Jun 22 19:43:47.360718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 329/628] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:47 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:48.335074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:48.336161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:48.347200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:48.347938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:48.349260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:48.350319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:48.377124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:48.377730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:48.384653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:48.385067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:48.386072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:48.386500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:48.484955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:48.493326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:48.494818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:48.495969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f20c168f-a6ec-4eaf-9e65-7291d997b3eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.167561 Jun 22 19:43:48.496821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 300/629] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:48 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:48.521717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:48.529483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a0083da4-29fb-4005-8570-9ffdea776b33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.156204 Jun 22 19:43:48.530058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 330/630] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:48 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:49.514640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:49.515162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:49.522135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:49.522581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:49.523334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:49.523765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:49.547659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:49.548478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:49.556875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:49.557594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:49.558862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:49.559921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:49.659999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:49.667979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:49.669572 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:49.670728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0f75f370-5b33-4253-be85-1f9021e4f1b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.160174 Jun 22 19:43:49.671284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 301/631] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:49 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:49.692667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:49.700178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9600d57c-c4fd-424d-ae43-a1814168b903 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.157133 Jun 22 19:43:49.700858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 331/632] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:49 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:50.690423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:50.690958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:50.698671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:50.699143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:50.699940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:50.700426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:50.716768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:50.717326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:50.724161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:50.724952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:50.725708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:50.726133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:50.833765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:50.841866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:50.843372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:50.844558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d17cee79-194a-48f4-99a9-bb6c25fbfdcd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.158428 Jun 22 19:43:50.845124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 302/633] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:50 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:50.858296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:50.865622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d1a7bf70-e2cc-4730-a2ec-d66155b40619 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.153104 Jun 22 19:43:50.866178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 332/634] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:50 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:51.866187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:51.866795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:51.876225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:51.876669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:51.877421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:51.877847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:51.882489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:51.883092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:51.889753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:51.890190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:51.890971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:51.891393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:52.011720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:52.020012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:52.021616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:52.022789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-61c76d11-9991-4fda-b864-b11f67c5f7aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.162925 Jun 22 19:43:52.023337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 303/635] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:51 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:52.029602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:52.037053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aac73d65-e699-452a-9d16-20b97c182350 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.158327 Jun 22 19:43:52.037624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 333/636] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:51 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:43:53.041381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:53.041987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:53.050379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:53.050836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:53.051600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:53.052033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:53.053899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:53.054498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:53.061074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:53.061757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:53.062752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:53.063187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:53.183636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:53.192153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:53.192896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:53.194705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:53.195946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c2b04f9d-7b31-4054-ad8b-5b64ace780e1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.158535 Jun 22 19:43:53.196617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 304/637] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:53 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:53.199829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-26c23090-b06e-4683-8a5c-c44cbcfa451e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.149706 Jun 22 19:43:53.207009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 334/638] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:53 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:54.217744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:54.218957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:54.219555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:54.220450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:54.229272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:54.229913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:54.230203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:54.230858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:54.231150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:54.231658 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:54.233640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:54.233640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:54.369240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:54.371668 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:54.376788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-68ea606b-e8f8-4e9d-b02e-37acd331159b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.162772 Jun 22 19:43:54.377368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 335/639] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:54 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:54.379656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:54.381155 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:54.382297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-485a6b41-c46e-4d6f-80e0-2d16957f869a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.170481 Jun 22 19:43:54.382870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 305/640] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:54 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:55.393063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:55.393569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:55.399994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:55.400479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:55.400676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:55.401242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:55.401395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:55.401679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:55.407789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:55.408417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:55.409191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:55.409626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:55.530830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:55.538077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b51ecd38-2f65-476f-b6a4-21b401f6bd33 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.148976 Jun 22 19:43:55.538939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 336/641] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:55 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:55.540480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:55.548473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:55.549995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:55.551140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-75e128af-b615-49fb-8418-b62eeace902e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.154882 Jun 22 19:43:55.551687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 306/642] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:55 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:56.559084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:56.560088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:56.570882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:56.571579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:56.572900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:56.573140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:56.573833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:56.574093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:56.581381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:56.581819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:56.582568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:56.582989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:56.704849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:56.707335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:56.712658 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-caf96169-1c41-46a4-ad16-defdc784c2bb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.160243 Jun 22 19:43:56.713196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 337/643] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:56 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:56.715808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:56.717336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:56.718488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ee3a7da-f2b2-4090-8c81-f780a7310825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.151897 Jun 22 19:43:56.719069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 307/644] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:56 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:57.734059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:57.734950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:57.740167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:57.741189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:57.746265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:57.747149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:57.747947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:57.748429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:57.749750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:57.750195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:57.750914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:57.751365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:57.755376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:43:57.880692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:57.883161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:57.889047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:57.890521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:57.890850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2312c504-6a36-4918-929f-3b74f9b55f90 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.163302 Jun 22 19:43:57.891488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 338/645] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:57 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:57.891651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d5369290-095b-4230-9f42-e60a42e7d173 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.158131 Jun 22 19:43:57.892221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 308/646] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:57 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:43:58.912163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:58.913111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:43:58.913754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:58.913952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:43:58.924064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:58.924913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:58.925165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:58.925741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:58.926148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:58.926881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:58.927113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:43:58.927780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:43:59.069385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:59.070101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:59.077980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-457b827c-1ea7-4b54-bbe2-d3f6bff0b790 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.172235 Jun 22 19:43:59.078374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:59.080384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 339/647] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:43:58 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:43:59.080479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:43:59.081279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-36a0d5e1-b196-4bac-af5f-85ee32c179ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.175036 Jun 22 19:43:59.083912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 309/648] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:43:58 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:00.098888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:00.100268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:00.103275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:00.104371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:00.109219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:00.109675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:00.110457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:00.110880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:00.112133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:00.112582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:00.113461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:00.113803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:00.243573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:00.243887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:00.251608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-049c1e50-6268-425a-95eb-0fe7df44cb7c tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.159512 Jun 22 19:44:00.252200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 340/649] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:00 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:00.256357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:00.257896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:00.259083 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-eb5a3047-fc6e-4bc0-b6f3-f9d917c393ba tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.162993 Jun 22 19:44:00.259626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 310/650] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:00 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:01.273524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:01.273524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:01.280725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:01.281406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:01.282263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:01.282708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:01.283475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:01.283914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:01.287953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:01.288426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:01.289195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:01.289624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:01.416461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:01.419874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:01.423617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:01.425111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-12baed71-6aeb-42eb-a3e8-fab5a7ea8bb2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.159133 Jun 22 19:44:01.425691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 341/651] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:01 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:01.435918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:01.437426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:01.438600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-56178e66-9feb-49d1-a310-f7ebadd74a24 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.163107 Jun 22 19:44:01.439149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 311/652] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:01 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:02.445752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:02.446708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:02.454827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:02.455287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:02.456072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:02.456532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:02.456711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:02.457297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:02.464293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:02.464748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:02.465506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:02.466191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:02.590422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:02.592651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:02.600847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:02.602347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:02.603503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9f8cb6df-96b2-4597-a7e4-a590d6b1b697 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.150802 Jun 22 19:44:02.604062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 312/653] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:02 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:02.613138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eab26ffe-1b56-4d98-9295-6eb69798d918 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.173838 Jun 22 19:44:02.613809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 342/654] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:02 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:03.621505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:03.622115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:03.629347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:03.629629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:03.630115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:03.630222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:03.630545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:03.630973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:03.636828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:03.637274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:03.638030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:03.638452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:03.760952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:03.769287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:03.776724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7328c00d-9a45-43e3-84ee-fddb93d983af tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.150944 Jun 22 19:44:03.778010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 343/655] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:03 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:03.778779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:03.780337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:03.781491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-80f163dc-5751-42bd-9b95-7f374a0e5cf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.164015 Jun 22 19:44:03.782039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 313/656] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:03 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:04.796609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:04.797353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:04.800011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:04.801144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:04.803907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:04.804394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:04.805333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:04.805914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:04.808610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:04.809218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:04.810069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:04.810600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:04.938642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:04.944554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:04.946368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e27fc6aa-195a-4afc-9bee-e27d9d424dcb tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.154916 Jun 22 19:44:04.946945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 344/657] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:04 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:04.952645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:04.954115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:04.955973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10a3354d-27b0-478c-b342-e27d09b3e9c7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.159465 Jun 22 19:44:04.957010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 314/658] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:04 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:05.274049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ef61e4-c1fb-4b7f-80d3-a63fa09df7c7"}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:05.275193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:05.282213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:05.282992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:05.284172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:05.284623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:05.968779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:05.969348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:05.976821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:05.977249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:05.978010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:05.978442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:06.109429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:06.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ce1fefa2-01de-4237-a5ca-a028713e893b tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.153276 Jun 22 19:44:06.117861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 315/659] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:05 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:44:06.122222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:06.122821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:06.128571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:06.129025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:06.129783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:06.130209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:06.539221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:06.551911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:06.554261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:06.556255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7398ebf7-57c4-40e9-9b8b-5c40f455e3c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.437057 Jun 22 19:44:06.557060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 316/660] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:06 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:07.138172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:07.138889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:07.146267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:07.146759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:07.147595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:07.148072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:07.278235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:07.286159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9e4df777-0a9c-48de-9124-a1065102c4b6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.154422 Jun 22 19:44:07.286722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 317/661] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:07 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:07.579071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:07.580072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:07.590392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:07.591194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:07.592506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:07.593228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:07.736929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:07.748849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:07.751215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:07.753006 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cf7dc1c0-13f5-47e1-8d77-503dffa8d9e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1722 microversion: 2.20 time: 0.180399 Jun 22 19:44:07.753710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 318/662] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:07 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:07.975095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7d1b810f-c59b-4d21-bff1-29b10ca0cf9c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "POST /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.824132 Jun 22 19:44:07.975689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 345/663] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 19:44:05 2022] POST /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e/os-volume_attachments => generated 194 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:44:08.306539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:08.307268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:08.317045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:08.317563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:08.318480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:08.318992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:08.454688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:08.462206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0a0dd9d7-3774-45bd-8c31-10aeb09a5d3f tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.161520 Jun 22 19:44:08.462763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 319/664] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:08 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:08.772224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:08.772937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:08.779479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:08.779983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:08.780885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:08.781329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:08.918364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:08.930362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:08.932724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:08.934355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-216ebc99-8d96-40a7-8836-a89fcb1e887d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.166728 Jun 22 19:44:08.934911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 346/665] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:08 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:09.134208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8192de99-0953-40a8-bbda-14c7271203b8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:09.140519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8192de99-0953-40a8-bbda-14c7271203b8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.140970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8192de99-0953-40a8-bbda-14c7271203b8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.199587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8192de99-0953-40a8-bbda-14c7271203b8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Going to try to stop instance {{(pid=124856) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 19:44:09.246331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8192de99-0953-40a8-bbda-14c7271203b8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action" status: 202 len: 0 microversion: 2.1 time: 0.115879 Jun 22 19:44:09.246955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 320/666] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:44:09 2022] POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:44:09.255060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:09.255673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:09.262923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.263374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.264145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.264671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.405119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:09.416853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-368ee57a-2cbf-4921-a1d8-45ed29459381 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.165489 Jun 22 19:44:09.417495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 347/667] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:09.483343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:09.484190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:09.494239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.494893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.495997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.496655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.631226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:09.638953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1d42697c-b6b9-46f1-b683-caef061632f7 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.163036 Jun 22 19:44:09.639511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 321/668] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:09 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:09.955324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:09.956029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:09.964043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.964608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:09.965502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:09.966005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:10.113169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:10.121340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:10.122997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:10.124191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c2eadf2d-71b4-4eda-8ab4-947deddefb3b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.173447 Jun 22 19:44:10.124899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 348/669] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:09 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:10.434395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:10.435161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:10.442009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:10.442514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:10.443277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:10.443712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:10.630615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:10.638947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e15fcc1b-29cb-4a99-9ea5-b7ad2c79baf6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.208641 Jun 22 19:44:10.639512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 322/670] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:10.657507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:10.658130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:10.667366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:10.667905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:10.668965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:10.669398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:10.798479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:10.809487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7c9aecd4-9342-44de-be45-c236b2f7458e tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1313 microversion: 2.1 time: 0.157656 Jun 22 19:44:10.810251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 349/671] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:10 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:11.146760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:11.147917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:11.158354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.159006 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.159859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.160248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.303884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:11.308820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:11.316239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:11.318531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:11.320316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9f773dbd-dd29-4bf4-8373-180af40c427e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.180130 Jun 22 19:44:11.320970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 323/672] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:11 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:11.658142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:11.658829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:11.666870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.667395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.668327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.668840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.803853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:11.812665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-36e2a683-b3eb-4eea-8efd-495ffe66b339 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.159137 Jun 22 19:44:11.813261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 350/673] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:11.827542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:11.828141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:11.835562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.836005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.836794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:11.837212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:11.967995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:11.975966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-186fb66e-2d69-4b64-83bf-8fe914be9835 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1498 microversion: 2.1 time: 0.153020 Jun 22 19:44:11.976557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 324/674] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:11 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:44:12.338787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:12.339381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:12.345405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:12.345857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:12.346602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:12.347009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:12.480770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:12.489145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:12.490741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:12.492007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b46eccca-1e7a-4137-8abe-d776497a8258 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.157131 Jun 22 19:44:12.492720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 351/675] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:12 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:12.834066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:12.834997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:12.845988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:12.846726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:12.847969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:12.848745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:12.981998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:12.994768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e4b00249-0fc8-489f-9850-223c8d661d63 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.167005 Jun 22 19:44:12.995656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 325/676] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:13.511345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:13.511950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:13.518987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:13.519434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:13.520223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:13.520657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:13.659228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:13.670847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:13.672354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:13.673514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a0cee5de-f654-4b9c-8ade-ddd0c7066bd7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.166152 Jun 22 19:44:13.674030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 352/677] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:13 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:14.017202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:14.017775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:14.024870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:14.025325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:14.026163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:14.026604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:14.131893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-8df39325-c02b-469c-aeb7-92a88a6b139d req-8ea60bbc-2615-4525-ab28-9f6dbb57585a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "name": "network-vif-plugged", "status": "completed", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:14.141482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-8df39325-c02b-469c-aeb7-92a88a6b139d req-8ea60bbc-2615-4525-ab28-9f6dbb57585a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:14.141920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-8df39325-c02b-469c-aeb7-92a88a6b139d req-8ea60bbc-2615-4525-ab28-9f6dbb57585a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:14.153982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-8df39325-c02b-469c-aeb7-92a88a6b139d req-8ea60bbc-2615-4525-ab28-9f6dbb57585a service nova] Creating event network-vif-plugged:6a6fc786-b0fd-4333-a1bb-cbc2584be0e0 for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 on hv-cinder-84721 Jun 22 19:44:14.159026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-8df39325-c02b-469c-aeb7-92a88a6b139d req-8ea60bbc-2615-4525-ab28-9f6dbb57585a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Jun 22 19:44:14.159733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:14.159980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 353/678] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:44:14.168364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1bfa7923-7d6c-4080-91d7-723fe310a1e5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.155025 Jun 22 19:44:14.168931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 326/679] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:14.697264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:14.698356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:14.708951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:14.709685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:14.710926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:14.711631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:14.859678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:14.872339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:14.873843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:14.874988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cfa5dea5-7b7f-4e19-8df1-6d3e371480df tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.185466 Jun 22 19:44:14.875550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 354/680] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:14 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:15.189694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:15.190515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:15.201034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:15.201482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:15.202247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:15.202681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:15.347350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:15.356259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d5bed2f4-d8bd-4cf5-823d-73debba257c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.173087 Jun 22 19:44:15.356835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 327/681] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:15.898038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:15.898953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:15.909961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:15.910709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:15.911963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:15.912744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:16.052818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:16.060925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:16.062493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:16.063660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b5987f12-14a6-4443-905c-e9c96dc4cff6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1743 microversion: 2.20 time: 0.172381 Jun 22 19:44:16.064234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 355/682] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:15 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:16.374739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:16.375210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:16.377477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=60 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:16.388587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:16.389047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:16.389824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:16.390277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:16.536839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:16.545047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-da8e09b5-0f0d-43f1-916b-2612d522b5f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.174998 Jun 22 19:44:16.545616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 328/683] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:17.082978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:17.083777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:17.086359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=56 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:17.093238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:17.093769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:17.094473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:17.094899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:17.278422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:17.297318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:17.299056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:17.300345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cb3592c9-5872-401f-a58a-c1bb068420f0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.221749 Jun 22 19:44:17.301118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 356/684] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:17 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:17.562953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:17.564395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:17.571607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:17.572056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:17.572854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:17.573316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:17.741895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:17.751589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b605f53f-2c67-4659-afaf-330419df56c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.193266 Jun 22 19:44:17.762136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 329/685] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:44:18.320909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:18.321778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:18.330521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:18.331077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:18.332159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:18.332931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:18.494062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:18.497805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:18.504126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:18.505916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:18.507183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f8c6b37a-99a4-4418-83ae-6abe6624e5bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.191029 Jun 22 19:44:18.507932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 357/686] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:18 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:18.770082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:18.771601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:18.780140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:18.780439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:18.781457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:18.781881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:18.922446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:18.930535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a95d456c-6f01-455e-83a4-c4b1835e63ed tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.164828 Jun 22 19:44:18.931922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 330/687] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:19.525944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:19.526552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:19.536530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:19.536889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:19.537686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:19.538119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:19.674518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:19.682923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:19.684486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:19.685645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7ca9db24-c070-4d27-aae0-925136555519 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.163681 Jun 22 19:44:19.696371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 358/688] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:19 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:19.947476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:19.948229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:19.955102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:19.955737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:19.956537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:19.956969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:20.098497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:20.107036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3fa1d1dc-41a6-4e56-8a6f-5b87db4de38e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.163474 Jun 22 19:44:20.107611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 331/689] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:20.703669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:20.704343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:20.711229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:20.711689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:20.712462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:20.712890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:20.873325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:20.884270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:20.886137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:20.887647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-685ea6b5-1c10-4048-90e9-935c7082aad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.188313 Jun 22 19:44:20.888234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 359/690] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:20 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:21.125486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:21.126605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:21.133325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:21.134218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:21.134662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:21.135157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:21.284567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:21.293878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3a6c50aa-dc00-4f4b-a0d6-bd05179cc2eb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.173540 Jun 22 19:44:21.294466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 332/691] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:21.906552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:21.907152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:21.914214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:21.914655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:21.915416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:21.915839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:22.058720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:22.074466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:22.076045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:22.079038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-177085d6-e994-4336-b8d8-de1e2cb008c8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.176250 Jun 22 19:44:22.081548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 360/692] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:21 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:22.311909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:22.313391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:22.320874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:22.322590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:22.323646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:22.324230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:22.482500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:22.493862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9548a94b-220f-4233-86eb-c0f4dba7d8f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.185828 Jun 22 19:44:22.494942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 333/693] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:23.098853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:23.099789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:23.109547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:23.109992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:23.110761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:23.111189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:23.254533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:23.267088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:23.269531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:23.271592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-292b5e54-7fb5-4af1-a7f8-ec220c9215e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.176804 Jun 22 19:44:23.272679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 361/694] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:23 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:23.512002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:23.512601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:23.520160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:23.520859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:23.522600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:23.523032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:23.666138 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:23.676191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0a2b259d-067c-4cab-8a47-40184f25c311 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.168434 Jun 22 19:44:23.676981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 334/695] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:24.295681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:24.298932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:24.306099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:24.306545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:24.307305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:24.307728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:24.447243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:24.456157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:24.457665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:24.458895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4f7a1781-9bb1-42cd-ac72-3850cc80cbd2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.168000 Jun 22 19:44:24.459471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 362/696] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:24 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:24.693595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:24.694283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:24.702541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:24.702989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:24.703921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:24.704378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:24.856031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:24.864703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ecb6088d-d60f-4324-a7db-db9f8fbf7fdd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.175216 Jun 22 19:44:24.865462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 335/697] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:25.477792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:25.478413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:25.485336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:25.485775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:25.486524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:25.486946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:25.618673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:25.630329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:25.632665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:25.634521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-092da5ec-c5ff-4b00-9d4f-70a73b7f99e2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1738 microversion: 2.20 time: 0.160640 Jun 22 19:44:25.635256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 363/698] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:25 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:25.885827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:25.886755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:25.894643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:25.895161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:25.896037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:25.896583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:26.040013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:26.048548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-209b6dcc-9cdc-427f-9bf3-edbfe1389749 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.169211 Jun 22 19:44:26.049130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 336/699] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:26.653019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:26.653626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:26.660565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:26.661016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:26.661783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:26.662216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:26.793924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:26.801977 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:26.803480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:26.804676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-59c971a0-99fa-4d8e-8af0-2badac878201 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1720 microversion: 2.20 time: 0.155655 Jun 22 19:44:26.805241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 364/700] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:26 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:27.066236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:27.066808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:27.073366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:27.073807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:27.074614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:27.075037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:27.212927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:27.225662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8f2995a9-5eb1-4d7c-9535-d2d3d18c7fae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.163156 Jun 22 19:44:27.226242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 337/701] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:27 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:27.826681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:27.827505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:27.836559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:27.837153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:27.838214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:27.838791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:27.975828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:27.984236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:27.985760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:27.986915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b15a91bd-586f-48d8-bde1-225f11fcdb56 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1720 microversion: 2.20 time: 0.166583 Jun 22 19:44:27.987489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 365/702] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:27 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:28.248378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:28.249141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:28.257245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:28.257779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:28.258716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:28.259233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:28.402380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:28.410653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ff5edd33-3a6c-44ae-b876-05fb633b50ae tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.169173 Jun 22 19:44:28.411187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 338/703] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:29.005156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:29.005709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:29.014656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.015177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.015967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.016422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.158028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:29.166363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:29.167788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:29.169050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-88de6631-db15-4fbd-92ee-97eb80b0508c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 200 len: 1723 microversion: 2.20 time: 0.167859 Jun 22 19:44:29.169599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 366/704] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:44:29 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:44:29.191726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f3c5d99-af16-4911-805e-12e405ff8d67"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:29.192913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:29.199456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.199907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.200710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.201142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.428250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:29.428803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:29.435232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.435681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.436487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:29.436928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:29.568147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:29.576555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48b7ee01-e0f6-4ff1-8639-61d9f2e26c1d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.152314 Jun 22 19:44:29.577122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 367/705] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:30.174673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-fdbd64ab-4032-4dc8-8da7-ed972fc7a5f4 req-a4d3a675-a026-4d74-be75-67972cbd50dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "name": "network-vif-unplugged", "status": "completed", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:30.184303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-fdbd64ab-4032-4dc8-8da7-ed972fc7a5f4 req-a4d3a675-a026-4d74-be75-67972cbd50dc service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:30.184866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-fdbd64ab-4032-4dc8-8da7-ed972fc7a5f4 req-a4d3a675-a026-4d74-be75-67972cbd50dc service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:30.197127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.compute.server_external_events [req-fdbd64ab-4032-4dc8-8da7-ed972fc7a5f4 req-a4d3a675-a026-4d74-be75-67972cbd50dc service nova] Unable to find a host for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077. Dropping event network-vif-unplugged {{(pid=124857) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 19:44:30.198020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-fdbd64ab-4032-4dc8-8da7-ed972fc7a5f4 req-a4d3a675-a026-4d74-be75-67972cbd50dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027247 Jun 22 19:44:30.199032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 368/706] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 19:44:30.594198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:30.594806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:30.601911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:30.602365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:30.603134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:30.603567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:30.756629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:30.769313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-10ca5096-e366-4c0a-9bb1-bb48d60bb8b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.179012 Jun 22 19:44:30.769890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 369/707] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:31.793744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:31.794431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:31.801547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:31.802019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:31.802826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:31.803290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:31.936491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:31.944660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3e626d3f-86ac-4dbe-9208-b4a48cc522a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.157335 Jun 22 19:44:31.945226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 370/708] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:32.970104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:32.971125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:32.983531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:32.984320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:32.985570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:32.986273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:33.127615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:33.137516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1372e8d6-4730-48f5-b6ee-34d8d7e49011 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.174105 Jun 22 19:44:33.138127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 371/709] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:32 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:34.154938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:34.155598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:34.163526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:34.164062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:34.164847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:34.165282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:34.299471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:34.307835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2597b430-2632-4a8f-b6e5-bb791abf0518 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.156929 Jun 22 19:44:34.308537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 372/710] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:35.326126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:35.326713 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:35.333740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:35.334189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:35.334953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:35.335388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:35.480548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:35.488880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a4ac3845-01fc-44d1-9f1c-db0f1f438dff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.166722 Jun 22 19:44:35.489446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 373/711] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:36.506223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:36.506833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:36.513761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:36.514209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:36.514959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:36.515381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:36.661738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:36.672901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3d6c9f7d-dd7d-4985-ab8a-0b3f9352d3d3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.170213 Jun 22 19:44:36.673692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 374/712] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:37.696408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:37.697399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:37.704919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:37.705390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:37.706198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:37.706655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:37.710837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:37.837491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:37.849762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9ef2aa0b-10d9-4639-a673-2b5330fe439c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.158429 Jun 22 19:44:37.850561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 375/713] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:38.869568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:38.870394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:38.877264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:38.877709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:38.878461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:38.878882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:39.007443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:39.020510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3c9f1865-98fb-409a-82ea-2cabb7cc5815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.156079 Jun 22 19:44:39.021336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 376/714] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:39.196896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=23 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:39.219350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=94 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:44:40.042352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:40.043055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:40.050279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:40.050732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:40.051496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:40.051927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:40.190254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:40.198959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8304e37b-052d-4016-9812-ee826381d641 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1722 microversion: 2.1 time: 0.163061 Jun 22 19:44:40.199537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 377/715] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:41.219901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:41.220998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:41.232257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:41.233009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:41.234251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:41.234956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:41.365120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:41.373117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2ddf3cf7-894e-4466-9ae8-0954e4fd3eb6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1699 microversion: 2.1 time: 0.159711 Jun 22 19:44:41.373683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 378/716] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:41.389049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-973a80c2-cd48-4642-9277-751627260067 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:44:41.394769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-973a80c2-cd48-4642-9277-751627260067 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:41.395211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-973a80c2-cd48-4642-9277-751627260067 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:41.455222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-973a80c2-cd48-4642-9277-751627260067 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Going to try to start instance {{(pid=124857) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 19:44:41.505715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-973a80c2-cd48-4642-9277-751627260067 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action" status: 202 len: 0 microversion: 2.1 time: 0.120072 Jun 22 19:44:41.509324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 379/717] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:44:41 2022] POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:44:41.515973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:41.516734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:41.523320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:41.523729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:41.524555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:41.525006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:41.662371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:41.670739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bc2b3ff7-43ea-46ef-b7a9-525e0e2ecfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1708 microversion: 2.1 time: 0.158840 Jun 22 19:44:41.671336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 380/718] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:42.690026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:42.691025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:42.701449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:42.702155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:42.703326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:42.703993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:42.843114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:42.851950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f6999932-3c11-487f-898f-035917d3ff4b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1708 microversion: 2.1 time: 0.167853 Jun 22 19:44:42.852554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 381/719] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:44:43.869877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:44:43.870576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:44:43.877483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:43.877940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:43.878699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:44:43.879131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:44:44.030717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:44:44.039172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e6d26e72-93dd-458f-8289-27c2b96f1417 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1712 microversion: 2.1 time: 0.173260 Jun 22 19:44:44.039729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 382/720] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:44:43 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:29.265102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:29.266230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:29.269684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=53 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:45:29.270733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:45:29.278939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:29.279386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:29.280151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:29.280593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:29.306757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:45:29.312728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.compute.api [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Working on deleting snapshot 98fc5e05-938d-435b-8a25-bf670c612349 from shelved instance... Jun 22 19:45:29.818189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Doing local delete in cell 4ffa8d7d-d486-428a-890e-0435466b218e(cell1) {{(pid=124857) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 22 19:45:29.818985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:29.819422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:29.820178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.compute.api [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 22 19:45:29.827552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] deallocate_for_instance() {{(pid=124857) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 22 19:45:30.771023 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Updating instance_info_cache with network_info: [] {{(pid=124857) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 22 19:45:31.143051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-01b1d7d1-e0f7-400b-91f5-6ed5c9ef9788 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 204 len: 0 microversion: 2.20 time: 1.884886 Jun 22 19:45:31.143676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 383/721] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jun 22 19:45:29 2022] DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 0 bytes in 1887 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 19:45:31.149114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:45:31.149721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:31.155947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.156420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.157176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.157603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.180953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lazy-loading 'flavor' on Instance uuid bd94079a-3077-4049-b0a1-f51dfdb0b821 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:45:31.259408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4f4ceb0-1e74-4f9b-8d3a-7ee81947ba8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "POST /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821/action" status: 202 len: 0 microversion: 2.1 time: 0.114314 Jun 22 19:45:31.260037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 384/722] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 19:45:31 2022] POST /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:45:31.329148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-f9557e28-d374-4b7a-a120-ed98175a8217 req-cb3943a3-1ce5-457b-b7d0-c2f8f1e63e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f1a7b5-b17d-4ab9-b756-dd1d5e726077", "name": "network-vif-deleted", "tag": "6a6fc786-b0fd-4333-a1bb-cbc2584be0e0"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:45:31.338560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f9557e28-d374-4b7a-a120-ed98175a8217 req-cb3943a3-1ce5-457b-b7d0-c2f8f1e63e0e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.338993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f9557e28-d374-4b7a-a120-ed98175a8217 req-cb3943a3-1ce5-457b-b7d0-c2f8f1e63e0e service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.350418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.compute.server_external_events [req-f9557e28-d374-4b7a-a120-ed98175a8217 req-cb3943a3-1ce5-457b-b7d0-c2f8f1e63e0e service nova] Unable to find a host for instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077. Dropping event network-vif-deleted {{(pid=124857) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 19:45:31.351270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-f9557e28-d374-4b7a-a120-ed98175a8217 req-cb3943a3-1ce5-457b-b7d0-c2f8f1e63e0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090166 Jun 22 19:45:31.351851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 385/723] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 19:45:31.356529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:31.357210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:31.362888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.363310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.364052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.364506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.377387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 HTTP/1.1 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:45:31.378985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 19:45:31.380695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '33f1a7b5-b17d-4ab9-b756-dd1d5e726077'} Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:45:31.381499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 19:45:31.383264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:45:31.385517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:45:31.385517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f51e8176-5d8a-4bc1-a4a5-aa4854e2648b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 404 len: 111 microversion: 2.20 time: 0.027385 Jun 22 19:45:31.385517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 386/724] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:31 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:45:31.385517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:31.385913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:31.391428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.391864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.392653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:31.393074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:31.532131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:31.540065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1b8dd7a3-3fe9-4980-a23c-ad69854b40ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158250 Jun 22 19:45:31.540752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 387/725] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:31.546950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e150e57-a90c-436d-8464-c363df9322f7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '.version_select at 0x7fdc19c07790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:31.565816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2e150e57-a90c-436d-8464-c363df9322f7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858010710" status: 204 len: 0 microversion: 2.20 time: 0.024054 Jun 22 19:45:31.566388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 388/726] 10.222.0.26 () {60 vars in 1261 bytes} [Wed Jun 22 19:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858010710 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 19:45:32.455083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d022ff4c-d9f2-46fd-8d98-e5378ea01a72 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'create', calling method: .version_select at 0x7fdc19c4bee0>, body: {"keypair": {"name": "tempest-keypair-382469645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWl/xWM5ANsJd6N2nceFrk5cATQBVIoAcOCHY+5AeSf2o8U8z1ncIQ+N8f2a7vA4m0OfqpYDdywtX7ZIXRE+Q9uRXS6ZnQoX1HboNoZTYFjvYNFpFRTENmfNaKkj0vTLg=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:45:32.471330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d022ff4c-d9f2-46fd-8d98-e5378ea01a72 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for project b90964fa17494782b2a49ff54cfede88. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:45:32.475683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d022ff4c-d9f2-46fd-8d98-e5378ea01a72 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for user 20ef6f7c907b407b9d76bc814749d403 and project b90964fa17494782b2a49ff54cfede88. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:45:32.499812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d022ff4c-d9f2-46fd-8d98-e5378ea01a72 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049327 Jun 22 19:45:32.500452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 389/727] 10.222.0.26 () {62 vars in 1199 bytes} [Wed Jun 22 19:45:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 22 19:45:32.558450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:32.559050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:32.565451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:32.565901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:32.566668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:32.567106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:32.743253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:32.751106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-370f1d83-25a8-4a54-856a-15354e7ba058 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.197302 Jun 22 19:45:32.751663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 390/728] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:45:33.768257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:33.768889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:33.775434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:33.775879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:33.776657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:33.777082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:33.914995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:33.923051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-21eede8d-d7da-4f31-ba6a-3669a2edc32f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158644 Jun 22 19:45:33.923629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 391/729] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:45:33.928466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-437154613", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ef8d1f8-8ba0-448f-a40d-510d579e6402"}], "security_groups": [{"name": "tempest-securitygroup--710835489"}], "key_name": "tempest-keypair-382469645", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:45:34.028253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] validate_networks() for [('0ef8d1f8-8ba0-448f-a40d-510d579e6402', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:45:34.449148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:45:34.449564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:45:34.450034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:45:34.450431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:45:34.450836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:45:34.460313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:34.460730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:34.461525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:34.461957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:34.479255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for project b90964fa17494782b2a49ff54cfede88. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:45:34.483636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Getting quotas for user 20ef6f7c907b407b9d76bc814749d403 and project b90964fa17494782b2a49ff54cfede88. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:45:34.495675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:45:34.498011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:45:34.546053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b438fbe8-feaa-4a53-88e5-f2af2555abae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.621416 Jun 22 19:45:34.546760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 392/730] 10.222.0.26 () {62 vars in 1187 bytes} [Wed Jun 22 19:45:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 19:45:34.556405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:34.557012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:34.612537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:34.620596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:34.622081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:34.623151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-615bbe05-532f-4681-a9d8-45f6e578b228 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070433 Jun 22 19:45:34.623739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 393/731] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:34 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:34.697964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:45:34.698793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:45:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-volume_attachments (ip 10.222.0.26) !!! Jun 22 19:45:34.944413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:34.945446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:34.955549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:34.956343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:34.957585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:34.958299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:35.088865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:35.098309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-070af94a-6d5d-4d7f-b100-145baeb9da1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160268 Jun 22 19:45:35.099208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 394/732] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:35.641193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:35.641786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:35.693265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:35.701563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:35.703404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:35.704591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b4f82009-60cd-4c3f-b9ba-ed246e0cd2bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067309 Jun 22 19:45:35.705157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 395/733] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:35 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:36.124615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:36.125640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:36.136347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:36.136797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:36.137562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:36.137996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:36.274152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:36.286030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ec78533-ff62-40d5-a622-b9fff3be638b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167729 Jun 22 19:45:36.286778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 396/734] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:36.727465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:36.728488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:36.787318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:36.795352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:36.796916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:36.798018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-072e5e3a-e26b-46fc-9e48-427a560f4ee9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077721 Jun 22 19:45:36.798579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 397/735] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:37.306856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:37.307561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:37.315716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:37.316258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:37.317138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:37.317643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:37.322768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:45:37.449875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:37.457572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-022728aa-cc94-4769-a642-37b39350342f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157291 Jun 22 19:45:37.458143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 398/736] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:37.820016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:37.821048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:37.876492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:37.883932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:37.885534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:37.886621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4568456e-d316-4389-b933-ef61f94becef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073115 Jun 22 19:45:37.887183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 399/737] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:38.474546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:38.475107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:38.482727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:38.483169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:38.483929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:38.484393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:38.630500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:38.638536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b12afe34-dec9-44ce-8654-7de638b8efe7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168131 Jun 22 19:45:38.639132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 400/738] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:38.908539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:38.909552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:38.969532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:38.977362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:38.978890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:38.979974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8b1f9582-c2cf-4757-a4e6-0ed16cfcffe3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077965 Jun 22 19:45:38.980555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 401/739] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:38 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:39.659917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:39.661019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:39.672945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:39.673682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:39.674951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:39.675679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:39.813871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:39.821618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7a030657-a8ca-4d22-83b1-1ee4e61f0fe9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168349 Jun 22 19:45:39.822280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 402/740] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:40.003481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:40.004541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:40.065277 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:40.075102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:40.076642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:40.077758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-42267cf5-dba6-4cc7-a18d-a9c2a2f9ee26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082211 Jun 22 19:45:40.078322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 403/741] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:39 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:40.842779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:40.843852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:40.854969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:40.855401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:40.856163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:40.856612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:40.988328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:40.996801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f3d85e17-def8-4e36-8490-f1ee0e31954e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160497 Jun 22 19:45:40.997349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 404/742] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:41.099000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:41.099885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:41.170927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:41.181894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:41.183413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:41.184562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-12046dde-0405-4b10-bc46-703cd67ee679 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.092309 Jun 22 19:45:41.185093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 405/743] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:42.014204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:42.014893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:42.021461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:42.021907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:42.022673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:42.023112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:42.154627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:42.162239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a53abdbb-27b4-4be0-81a5-4f5c7cc6a013 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.151906 Jun 22 19:45:42.162802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 406/744] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:45:42.211723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:42.212732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:42.217108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:45:42.271524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:42.278825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:42.280364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:42.281473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4a6952be-96c3-4de9-83be-3c7cc289733b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076191 Jun 22 19:45:42.282034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 407/745] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:42 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:45:43.182343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:43.183104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:43.190301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:43.190783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:43.191577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:43.192028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:43.344081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:43.352348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-914a35fc-91cb-4ea4-b990-9dd7c8b26587 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175894 Jun 22 19:45:43.352905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 408/746] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:43.357282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:43.357876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:43.408014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:43.415025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:43.416521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:43.417601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61ae3826-f669-4007-ad10-3b2d02b51edb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063800 Jun 22 19:45:43.418158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 409/747] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:44.373254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:44.373948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:44.383673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:44.384293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:44.385065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:44.385507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:44.469998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:45:44.531044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:44.539186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1c6a02c-76f5-4856-a284-134bf03a1df7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.172290 Jun 22 19:45:44.548203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 410/748] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:44 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:44.548203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:44.548203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:44.600739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:44.608510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:44.610000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:44.611099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55f992fa-b224-41d1-97f5-96b21e341c9a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070361 Jun 22 19:45:44.611704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 411/749] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:44 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:45.560662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:45.561757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:45.573868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:45.574612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:45.575873 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:45.576642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:45.711466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:45.719510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-26bf7ae9-c2d6-4ec7-b128-14512f8fec8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165376 Jun 22 19:45:45.720082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 412/750] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:45:45.724961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:45.725702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:45.777288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:45.784746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:45.786281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:45.787399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0c3154b0-8499-465a-8919-ba60b0c6bc5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066416 Jun 22 19:45:45.788163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 413/751] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:46.741472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:46.742471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:46.754788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:46.755532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:46.756851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:46.757572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:46.901922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:46.910032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6cc2cf83-0003-4132-835e-b710df0ca820 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175377 Jun 22 19:45:46.910615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 414/752] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:46.914996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:46.915627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:46.966354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:46.974150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:46.975643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:46.976766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8fe9f2ae-8add-4873-9ff2-8cb51d08ce26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065251 Jun 22 19:45:46.977325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 415/753] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:47.931064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:47.932488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:47.944649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:47.945175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:47.946077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:47.946865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:48.088633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:48.096258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-547efe0a-430f-4542-9511-650a6fa2b87a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171921 Jun 22 19:45:48.096831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 416/754] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:48.101469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:48.102063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:48.154657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:48.161869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:48.163351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:48.164499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-093f17f8-e01c-43c4-8491-aeda303f7a68 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066700 Jun 22 19:45:48.165079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 417/755] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:48 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:48.614648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-046e236f-b88d-429c-b33d-00fe41de5836 req-0d91a103-b2c5-41b8-a591-34521f7bae0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "name": "network-vif-unplugged", "status": "completed", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:45:48.624043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-046e236f-b88d-429c-b33d-00fe41de5836 req-0d91a103-b2c5-41b8-a591-34521f7bae0c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:48.624686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-046e236f-b88d-429c-b33d-00fe41de5836 req-0d91a103-b2c5-41b8-a591-34521f7bae0c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:48.636624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-046e236f-b88d-429c-b33d-00fe41de5836 req-0d91a103-b2c5-41b8-a591-34521f7bae0c service nova] Creating event network-vif-unplugged:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:45:48.646795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-046e236f-b88d-429c-b33d-00fe41de5836 req-0d91a103-b2c5-41b8-a591-34521f7bae0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093040 Jun 22 19:45:48.647494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 418/756] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:45:49.114671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:49.115360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:49.122016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:49.122463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:49.123311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:49.123738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:49.259207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:49.267951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-39edbd8d-4d75-42d7-97c7-f78f77f83cb3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157887 Jun 22 19:45:49.268571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 419/757] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:49.272992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:49.273593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:49.331017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:49.344617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:49.346105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:49.347205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ac56546f-7fc3-4ee1-9aa1-f0615b3bc28e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077729 Jun 22 19:45:49.347757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 420/758] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:50.289958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:50.295198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:50.300626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:50.301127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:50.301950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:50.302338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:50.446572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:50.454297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d936dade-4f46-4456-a0da-9cf4c7a68dc8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171113 Jun 22 19:45:50.454868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 421/759] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:45:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:45:50.459343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:50.459935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:50.510940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:50.518511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:50.519969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:45:50.521091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dc9f7ce7-e8c2-48ff-83b6-cac716e5d662 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065325 Jun 22 19:45:50.521681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 422/760] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:45:50 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:45:51.024883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:45:51.025458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:45:51.032944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:51.033476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:45:51.034369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:45:51.034884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:00.515116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=40 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:01.030375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=48 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:01.095591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=76 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:10.771772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lazy-loading 'services' on Instance uuid 498198b2-0179-45ba-8753-15a2d61e7018 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:46:12.853613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-84ae03e7-cc1c-4b42-b044-b09b7bf50e34 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments/47a885ec-402d-43ac-81c0-dd2ecb968b83" status: 202 len: 0 microversion: 2.1 time: 21.835346 Jun 22 19:46:12.857442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 423/761] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:45:51 2022] DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments/47a885ec-402d-43ac-81c0-dd2ecb968b83 => generated 0 bytes in 21840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:46:12.862558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:12.863242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:12.869562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:12.869961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:12.870935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:12.871358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:13.006129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:13.014286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-98f9b4ac-bde5-44ae-bed1-1cc6e8443e94 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155706 Jun 22 19:46:13.014862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 424/762] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:13.020337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:13.020937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:13.077304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:13.085552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:13.087088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:13.088451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2cfb8e02-7980-43bc-aa36-bbb0ad27a7a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071968 Jun 22 19:46:13.089117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 425/763] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:13 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:14.035035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:14.036157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:14.047317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:14.048069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:14.049433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:14.050155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:14.197776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:14.206018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-32f87fb9-078c-4768-a9c7-6db5acc7d299 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177536 Jun 22 19:46:14.206593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 426/764] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:14.210999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:14.211651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:14.262859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:14.270162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:14.271661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:14.272789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58e76151-3c96-4d7c-ba75-6abadabce0a7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065284 Jun 22 19:46:14.273357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 427/765] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:15.227288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:15.228072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:15.236822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:15.237341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:15.238233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:15.238736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:15.379330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:15.389669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f18a727a-ac52-4a81-b8f4-4a391cea9740 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169115 Jun 22 19:46:15.390644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 428/766] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:15.395711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:15.396571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:15.453349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:15.463446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:15.465006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:15.466092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ec542e89-f59f-4ee6-990d-34d99ad06dd5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074302 Jun 22 19:46:15.466909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 429/767] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:15 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:16.411306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:16.412351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:16.424416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:16.425171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:16.426532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:16.427253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:16.563367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:16.573927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-799f7679-f90d-4b8e-b221-c62bb5528a4f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169467 Jun 22 19:46:16.574494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 430/768] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:16.578846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:16.579439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:16.632063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:16.639585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:16.641105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:16.642195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ec14e891-2892-4d09-8613-6240fd2a1f1d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066785 Jun 22 19:46:16.642748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 431/769] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:16 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:17.594808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:17.595845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:17.606271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:17.606671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:17.607579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:17.608020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:17.734936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:17.743147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e2929be0-849f-45ff-96e6-5dcc54ab5d06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.154802 Jun 22 19:46:17.743720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 432/770] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:17.748078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:17.748719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:17.798040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:17.805279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:17.806768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:17.807892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8bb99f12-0e76-477a-bcef-1c2db87742b2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063167 Jun 22 19:46:17.808508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 433/771] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:17 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:18.763806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:18.764869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:18.775582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:18.776030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:18.776833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:18.777249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:18.907323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:18.915473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-06915066-2382-4c60-833e-caba285de893 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158300 Jun 22 19:46:18.916051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 434/772] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:18 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:18.920427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:18.920986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:18.971264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:18.978977 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:18.980501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:18.981593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c7aae9d3-a5d1-4fa2-8f7a-9be884c7186c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064608 Jun 22 19:46:18.982156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 435/773] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:18 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:19.935759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:19.936886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:19.948821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:19.949562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:19.950824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:19.951544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:20.111808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:20.119958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2ef0ae9d-5155-4704-a19c-b05047174faf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.190665 Jun 22 19:46:20.120560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 436/774] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:20.124860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:20.125443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:20.185745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:20.193670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:20.195212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:20.196368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bfe5d876-f9ca-455f-acb3-15181c540045 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074867 Jun 22 19:46:20.196935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 437/775] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:20 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:21.141474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:21.142460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:21.154368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:21.155116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:21.156429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:21.157156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:21.290643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:21.298587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-63d781b7-8982-4734-8f39-7cc952f4d6ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163620 Jun 22 19:46:21.299160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 438/776] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:21.303558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:21.304153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:21.363059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:21.370707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:21.372250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:21.373349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-47e8182e-fab5-420e-ad20-4a21911ff8ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073279 Jun 22 19:46:21.373910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 439/777] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:21 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:22.319755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:22.320883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:22.333750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:22.334489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:22.335742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:22.336406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:22.470571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:22.482065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13c1a8db-a80d-452e-b0f1-efbcac6bb169 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168342 Jun 22 19:46:22.482805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 440/778] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:22.487314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:22.487910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:22.538312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:22.545554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:22.547043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:22.548130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5a6a64d3-3306-4570-bfa4-d20c68e7a26d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064422 Jun 22 19:46:22.548678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 441/779] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:22 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:23.088237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:23.499641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:23.500299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:23.508230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:23.508700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:23.509463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:23.509869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:23.652747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:23.664499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d622171a-e86a-4339-81f6-fbd9386dce7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168476 Jun 22 19:46:23.665331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 442/780] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:23.669778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:23.670366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:23.728181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:23.739800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:23.741848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:23.743071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-faf02744-a1ec-4b56-851e-9a80600fbeee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076772 Jun 22 19:46:23.743635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 443/781] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:23 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:24.686026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:24.687043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:24.698934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:24.699715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:24.701084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:24.701802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:24.839102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:24.847025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5e08a607-978f-4943-842e-ce368757f21f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167578 Jun 22 19:46:24.847569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 444/782] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:24.852463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:24.853059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:24.902481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:24.909688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:24.911166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:24.912283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4613b641-7684-4dd1-b616-38c6b3f4854c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063324 Jun 22 19:46:24.912820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 445/783] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:24 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:25.867911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:25.868991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:25.880627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:25.881334 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:25.882558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:25.883156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:26.019011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:26.027082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-21d33652-8040-4989-be41-ba16de9bcc79 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165168 Jun 22 19:46:26.027850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 446/784] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:26.032051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:26.032828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:26.085087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:26.092915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:26.094397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:26.095497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2b641483-6a54-4cf2-81f3-e9f08778c8ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066870 Jun 22 19:46:26.096058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 447/785] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:26 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:27.048448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:27.049496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:27.061318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:27.062046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:27.063279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:27.063986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:27.212155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:27.219819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8ad40fb6-957e-4040-8810-babff1ab8e1f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177859 Jun 22 19:46:27.220422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 448/786] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:27.225038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:27.225655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:27.280045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:27.287349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:27.288948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:27.290032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c3be59d2-bfc6-4911-9896-3799acd7b763 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068714 Jun 22 19:46:27.290589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 449/787] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:27 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:28.241138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:28.242294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:28.250077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:28.250549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:28.251348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:28.251853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:28.389279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:28.397317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-da614243-b9ce-43d2-8eea-49346383ae76 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162568 Jun 22 19:46:28.397895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 450/788] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:28.402362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:28.402959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:28.455349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:28.463010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:28.464513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:28.465594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9e8c4741-5c62-42d3-be75-3f4d85102d36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066707 Jun 22 19:46:28.466352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 451/789] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:28 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:29.417046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:29.417972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:29.430166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:29.430904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:29.432183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:29.432911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:29.574356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:29.583221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-73c46045-00ad-4047-a7ff-c537ad3907ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171717 Jun 22 19:46:29.583803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 452/790] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:29.592615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:29.593227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:29.652950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:29.663659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:29.665665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:29.667295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aec2aca6-c26a-4172-ab4f-3967ee7ec2c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082064 Jun 22 19:46:29.668041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 453/791] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:29 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:30.603777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:30.604798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:30.617002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:30.617452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:30.618208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:30.618633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:30.636073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:30.754560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:30.766553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b42b238e-5433-4dd5-8eec-ca2c7cccc8d0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169281 Jun 22 19:46:30.767267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 454/792] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:30 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:30.771707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:30.772329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:30.826373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:30.833814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:30.835299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:30.836421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-833e81f4-8784-484b-82b2-2fa1e3064804 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068212 Jun 22 19:46:30.836982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 455/793] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:30 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:31.786853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:31.787993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:31.796079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:31.796567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:31.797314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:31.797795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:31.935911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:31.943787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb0f416e-81b2-494b-bb1c-bf8823a3be58 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163344 Jun 22 19:46:31.944391 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 456/794] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:31.948831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:31.949429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:31.952010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:32.002490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:32.013469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:32.015737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:32.017563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-80365d28-ed40-4542-8304-59249c38f3d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071963 Jun 22 19:46:32.018301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 457/795] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:31 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:32.964955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:32.965966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:32.977291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:32.978041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:32.979351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:32.980066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:33.128077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:33.139708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1ee9c9b-d179-40c9-ad35-8c3f57a0f694 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.181396 Jun 22 19:46:33.140324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 458/796] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:33.144852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:33.145461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:33.196684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:33.204136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:33.205636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:33.206737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7432a9bb-3b53-4343-9175-edbecba2b559 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065513 Jun 22 19:46:33.207298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 459/797] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:33 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:34.160562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:34.161636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:34.172169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:34.172952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:34.174206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:34.174933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:34.316551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:34.327837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f46c5f17-5ece-4470-a423-6a54f0462abc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.173582 Jun 22 19:46:34.328476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 460/798] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:34.333189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:34.333571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:34.389761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:34.396991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:34.398542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:34.399634 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4e46ea47-8fe5-49a3-bae1-171bf7b0b69f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070253 Jun 22 19:46:34.400210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 461/799] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:34 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:35.349646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:35.350651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:35.358493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:35.358937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:35.359689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:35.360086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:35.490918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:35.499112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eead7d11-6825-41b5-9f94-23ad2e9a62aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156677 Jun 22 19:46:35.499710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 462/800] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:35 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:35.504285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:35.504931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:35.557218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:35.571547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:35.573076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:35.574179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-50c24802-6613-4299-b272-8512249d818a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073537 Jun 22 19:46:35.574732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 463/801] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:35 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:36.519162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:36.519761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:36.528577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:36.529012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:36.529793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:36.530213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:36.670798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:36.678943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-153d9243-3835-459d-9b4f-eae0777fa2ed tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165946 Jun 22 19:46:36.679606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 464/802] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:36.683949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:36.684575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:36.734687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:36.742452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:36.743933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:36.745054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-72cd79e5-92a8-4b61-be3c-f9f9dac06cc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064539 Jun 22 19:46:36.745624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 465/803] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:37.696076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:37.696780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:37.704578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:37.705025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:37.705799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:37.706224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:37.835504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:37.843201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-967c6450-2ed7-41aa-8f20-4adbc45498c3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.151071 Jun 22 19:46:37.843761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 466/804] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:37.848459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:37.849130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:37.903639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:37.914822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:37.917179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:37.918779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6da42f92-9bc7-48bf-baf4-175854feaa04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073822 Jun 22 19:46:37.919571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 467/805] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:38.860828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:38.861510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:38.869110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:38.869552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:38.870303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:38.870724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:39.002579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:39.010166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f34cd979-7e0a-4c89-944f-5904afdd333e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.153219 Jun 22 19:46:39.010728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 468/806] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:39.015184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:39.015773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:39.067056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:39.074974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:39.076523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:39.077616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-507fb105-cd32-434b-9fdf-760691f965ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065977 Jun 22 19:46:39.078171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 469/807] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:39 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:40.031401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:40.032516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:40.042216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:40.042662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:40.043424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:40.043860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:40.175898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:40.184703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-42e9c885-5c8e-4845-9569-4c33ec14c60e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159761 Jun 22 19:46:40.185293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 470/808] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:40.189677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:40.190268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:40.241848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:40.249099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:40.250578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:40.251663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bdf5bff6-c8cb-4ed7-995e-62caf9fb6349 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065470 Jun 22 19:46:40.252237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 471/809] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:40 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:41.205908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:41.207052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:41.215851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:41.216346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:41.217114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:41.217549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:41.361868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:41.371503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5e6fac26-23a6-430b-a113-562dcc0a0812 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171769 Jun 22 19:46:41.372453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 472/810] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:41 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:46:41.376901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:41.377503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:41.430505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:41.432674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=49 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:41.439212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:41.440716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:41.441802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1779a08-5e05-4cd1-beff-af35f8d15363 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068446 Jun 22 19:46:41.442352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 473/811] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:42.393139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:42.394202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:42.403171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:42.403623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:42.404423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:42.404858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:42.554959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:42.562583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dd263f61-821c-43f1-8472-1882fe6ae367 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175979 Jun 22 19:46:42.563152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 474/812] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:42.567508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:42.568120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:42.628441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:42.635633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:42.637151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:42.638245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bebffe7f-0c43-4eff-9368-b95ebf2e7ff8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074209 Jun 22 19:46:42.638800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 475/813] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:42 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:43.582314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:43.582991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:43.748855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:43.749291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:43.750066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:43.750490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:43.893144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:43.902430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d57f3504-2107-45c7-b64d-42f774f70aa1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.326187 Jun 22 19:46:43.902959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 476/814] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:43.908202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:43.908876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:43.971201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:43.979236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:43.980754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:43.981961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a7aefa8f-76ee-4f07-bcb2-adff9362869c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077950 Jun 22 19:46:43.982509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 477/815] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:44.923736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:44.924895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:44.933925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:44.934367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:44.935117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:44.935547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:45.069754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:45.077792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-901e23fd-fb02-4525-98b2-a7c70340e2c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160390 Jun 22 19:46:45.078324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 478/816] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:44 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:45.082793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:45.083384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:45.137447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:45.145326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:45.146841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:45.147976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e3440717-2a52-4343-906a-1e1d246d5064 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068748 Jun 22 19:46:45.148603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 479/817] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:46.094963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:46.095590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:46.103343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:46.103794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:46.104606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:46.105038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:46.241373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:46.249014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2f82fd82-244e-4254-9f61-ac72900ca3c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157994 Jun 22 19:46:46.249577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 480/818] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:46.254103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:46.254698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:46.306422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:46.313991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:46.315487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:46.316620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bdada62c-6935-4f18-b254-acf26e39f081 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066131 Jun 22 19:46:46.317172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 481/819] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:47.270772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:47.271889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:47.280186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:47.280669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:47.281496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:47.281933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:47.412324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:47.420382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d62d20f0-a95a-44cc-8c72-d1e4e91db238 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155987 Jun 22 19:46:47.420954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 482/820] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:47.425391 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:47.425994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:47.476548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:47.483833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:47.485374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:47.486457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8fe8fff7-daaf-46f4-92b8-f90628e2e199 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064607 Jun 22 19:46:47.486997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 483/821] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:47 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:48.441276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:48.442405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:48.456446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:48.457188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:48.458433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:48.459145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:48.589722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:48.597399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-85fc91be-ad7a-4cbb-9787-c8b7e832c753 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162672 Jun 22 19:46:48.598286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 484/822] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:48.602701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:48.603289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:48.657972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:48.665644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:48.667146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:48.668276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8bec7dac-5242-4e26-b391-bf6ae69180c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069028 Jun 22 19:46:48.668834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 485/823] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:48 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:49.615081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:49.615736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:49.623196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:49.623575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:49.624387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:49.624820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:49.752326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:49.760475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f8fb0c4f-88b0-452f-969f-90745c0064ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.149008 Jun 22 19:46:49.761377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 486/824] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:49.767927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:49.768553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:49.828241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:49.835526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:49.837050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:49.838148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d96ea581-7c24-43eb-b8c6-af39ebb75132 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075458 Jun 22 19:46:49.838696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 487/825] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:50.789318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:50.790463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:50.802168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:50.802955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:50.804077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:50.804535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:50.808531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:50.954813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:50.963000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-40ee482d-5d53-4da2-bf51-27ff84813f25 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.180382 Jun 22 19:46:50.963563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 488/826] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:50.967976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:50.968577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:51.019611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:51.026932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:51.028468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:51.029568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8782df04-13c4-47d6-8253-8f42ae4b8146 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065088 Jun 22 19:46:51.030127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 489/827] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:50 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:51.984168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:51.985247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:51.990606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:46:51.999297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:52.000087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:52.001365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:52.002086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:52.142962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:52.151226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c5a970c2-2b5f-434b-b4eb-82e4d96e3500 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.173432 Jun 22 19:46:52.151783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 490/828] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:52.156160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:52.156772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:52.212044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:52.223375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:52.225737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:52.227338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a1bedba7-6f35-4326-b854-bde5e82da40a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074305 Jun 22 19:46:52.228123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 491/829] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:52 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:53.168052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:53.168766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:53.176252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:53.176711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:53.177481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:53.177921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:53.306745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:53.314368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-97101963-6a2e-4ff1-a7bb-d7ecd7441ddc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.150265 Jun 22 19:46:53.323707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 492/830] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:46:53.323707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:53.323707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:53.373612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:53.380810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:53.382446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:53.383556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-28c38c87-ba69-4cba-9ea0-e3e0209bd129 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067716 Jun 22 19:46:53.384133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 493/831] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:53 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:54.336716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:54.337945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:54.350585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:54.351055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:54.351827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:54.352332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:54.488621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:54.496864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7bbbca0a-9c60-4515-b9d0-ffb1c7ff0d38 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167675 Jun 22 19:46:54.497433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 494/832] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:54 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:54.501899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:54.502497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:54.564003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:54.575365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:54.577683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:54.579481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4e4f7895-940d-4a28-8e13-baf75415d9d7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.080840 Jun 22 19:46:54.580379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 495/833] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:54 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:55.516374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:55.517459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:55.529070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:55.529836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:55.531164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:55.531800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:55.666522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:55.678131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3647e1cc-5bb1-471a-b046-833a306f20f3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167423 Jun 22 19:46:55.678885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 496/834] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:55.685564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:55.686389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:55.741930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:55.749166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:55.750636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:55.751720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4e2f5edc-cb22-4b20-b6e8-c442cbf2aa91 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071748 Jun 22 19:46:55.752290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 497/835] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:55 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:56.703959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:56.705071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:56.714451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:56.714827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:56.715589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:56.716017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:56.852956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:56.860680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9576dce5-2f5c-4d74-9b46-b4e5390940ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163180 Jun 22 19:46:56.861306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 498/836] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:56.866057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:56.866915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:56.924054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:56.933361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:56.934848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:56.935938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ae08bc2a-7661-4d16-ab12-76ee2da93e16 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073730 Jun 22 19:46:56.936513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 499/837] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:56 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:57.882109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:57.883537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:57.897768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:57.898457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:57.899499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:57.900076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:58.057058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:58.065115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-695c3fb2-cf10-4c7d-996b-e2148f96486f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.189502 Jun 22 19:46:58.065659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 500/838] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:58.070139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:58.070730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:58.130060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:58.137752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:58.139230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:58.140369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1d9127b-2b14-4fd4-8131-b1ac3843d84d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073771 Jun 22 19:46:58.140930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 501/839] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:58 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:46:59.086178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:59.087228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:59.099565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:59.100360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:59.101643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:46:59.102365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:46:59.244772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:59.255145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ca382f65-a941-4809-9938-6f79fc5e3105 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175379 Jun 22 19:46:59.255907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 502/840] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:46:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:46:59.260344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:46:59.260927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:46:59.317701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:59.325830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:59.327452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:46:59.328552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2f679b2c-c01d-4b1a-8357-07cac1f27ca6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071651 Jun 22 19:46:59.329085 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 503/841] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:46:59 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:00.276588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:00.277420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:00.289089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:00.289693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:00.290626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:00.291060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:00.659525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:00.671242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1c67ec4-fedb-4590-a7e9-8bed4d8fa6cb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.400896 Jun 22 19:47:00.672079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 504/842] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:00.676458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:00.677056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:00.727178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:00.734760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:00.736284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:00.737410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-100b8a8e-5d11-4eea-a799-70fb75a8c4ec tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064400 Jun 22 19:47:00.738252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 505/843] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:00 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:01.692833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:01.693852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:01.702367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:01.702822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:01.703645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:01.704081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:01.834523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:01.842271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8598bbdc-404c-4e54-90ea-60f4ec508f93 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156080 Jun 22 19:47:01.842840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 506/844] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:01.847369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:01.848312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:01.909650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:01.916937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:01.918476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:01.919585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-67126299-9e55-4c1d-8e33-f8314cf94139 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075835 Jun 22 19:47:01.920132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 507/845] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:01 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:02.862211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:02.863101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:02.874130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:02.874582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:02.875346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:02.875780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:03.015023 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:03.023062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e97970d7-d9d5-4847-a30b-7ad1f872e929 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167001 Jun 22 19:47:03.023616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 508/846] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:03.028030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:03.028692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:03.081830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:03.093138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:03.095566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:03.097724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ff9e9847-fe19-4f18-b2f3-295387acbb5c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072526 Jun 22 19:47:03.098502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 509/847] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:03 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:04.044676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:04.045786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:04.056345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:04.057105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:04.058364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:04.059092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:04.197878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:04.210388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-adda3bcc-24e6-482d-9854-94ddbcb1374b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.172244 Jun 22 19:47:04.211173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 510/848] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:47:04.215721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:04.216354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:04.267269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:04.274912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:04.276433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:04.277526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b150ba7e-ac29-4f54-a7de-dfe53c9c94ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065372 Jun 22 19:47:04.278079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 511/849] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:04 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:05.230781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:05.231486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:05.239034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:05.239486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:05.240285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:05.240722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:05.376062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:05.384368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-17522a71-28bc-40a7-ae39-031aecb0f031 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158137 Jun 22 19:47:05.384941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 512/850] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:05.389342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:05.389938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:05.441254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:05.448985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:05.450481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:05.451581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1fa9de1a-ff2c-4faf-a167-3b6c021ac077 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065736 Jun 22 19:47:05.452133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 513/851] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:05 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:06.404859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:06.405938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:06.417980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:06.418729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:06.419993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:06.420781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:06.556971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:06.564968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f70eea4d-6882-4d82-bc2d-5650c4c518e4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166474 Jun 22 19:47:06.565535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 514/852] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:06.570096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:06.570692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:06.634931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:06.642406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:06.643900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:06.645029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7e500404-04fe-452a-82f3-b3adfaaa0e1a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078504 Jun 22 19:47:06.645598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 515/853] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:06 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:06.748308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:47:06.749271 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-volume_attachments (ip 10.222.0.26) !!! Jun 22 19:47:07.586177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:07.587173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:07.599551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:07.600324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:07.601579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:07.602369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:07.732639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:07.744514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7269fcd6-7080-435b-b469-9250e5a4a710 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.164530 Jun 22 19:47:07.745348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 516/854] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:07.752319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:07.753283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:07.806526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:07.814189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:07.815702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:07.816861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-67abf0ce-7e9a-4e0c-8d70-bfd82d967541 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070354 Jun 22 19:47:07.817416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 517/855] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:07 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:08.770736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:08.772996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:08.780384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:08.780836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:08.781606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:08.782035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:08.915805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:08.923984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-327e11d7-5663-4f4c-8723-bc63c65c3d6d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159825 Jun 22 19:47:08.924604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 518/856] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:08.929096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:08.929695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:08.982613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:08.994054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:08.996568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:08.998338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c5cc31c-7dda-4755-90df-cfe0f0d522b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072549 Jun 22 19:47:08.999167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 519/857] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:08 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:09.945601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:09.946539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:09.956652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:09.957124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:09.957958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:09.958415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:10.106749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:10.111674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:10.118680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-99290a45-9057-42bb-97be-3ec46e569baa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.179647 Jun 22 19:47:10.119241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 520/858] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:10.123779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:10.124397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:10.177313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:10.184974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:10.186477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:10.187575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b9e082cf-f5ae-462b-85c3-0567f81b732e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067428 Jun 22 19:47:10.188132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 521/859] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:10 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:11.135097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:11.135806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:11.142798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:11.143189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:11.143977 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:11.144421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:11.272722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:11.280852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e27f11e0-c5ff-4e30-b7a7-f2f34874ad5e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.149694 Jun 22 19:47:11.281409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 522/860] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:11.285724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:11.286315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:11.293293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:11.336758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:11.343920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:11.345430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:11.346518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d56e1956-8442-42f4-9728-5feacef4cf81 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064243 Jun 22 19:47:11.347075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 523/861] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:11 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:12.301993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:12.303026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:12.315084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:12.315838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:12.317163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:12.317878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:12.451720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:12.462448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-699c1744-4892-4744-aba7-62d0e07edc50 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167079 Jun 22 19:47:12.462997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 524/862] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:12.467595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:12.468200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:12.519714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:12.521954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=52 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:12.528293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:12.529762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:12.530864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-249032da-41d6-4eed-b4db-c1aa59b9d28c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066934 Jun 22 19:47:12.531415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 525/863] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:12 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:13.481700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:13.482310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:13.489639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:13.490086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:13.490838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:13.491260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:13.625052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:13.633244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0501ea6-ae55-4304-b1a4-4c19d8fec092 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156730 Jun 22 19:47:13.633837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 526/864] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:13.638412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:13.638942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:13.691172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:13.698492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:13.699987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:13.701120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4ff25b00-368b-40ad-9930-1df5071b1a8f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066346 Jun 22 19:47:13.701674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 527/865] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:13 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:14.654727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:14.655774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:14.667801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:14.668592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:14.669834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:14.670539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:14.817017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:14.825026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-31f89242-ee64-4088-9af1-669e1cc02019 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.176982 Jun 22 19:47:14.825591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 528/866] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:14.829956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:14.830549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:14.881515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:14.889171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:14.890654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:14.891740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ffd39097-db81-4cb4-8582-84bc52b31711 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065223 Jun 22 19:47:14.892346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 529/867] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:15.842584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:15.843273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:15.851198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:15.851641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:15.852481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:15.852903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:16.001761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:16.009802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-35f72ead-4a1e-48aa-b21a-e6674479fbf2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171148 Jun 22 19:47:16.010374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 530/868] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:16.014704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:16.015300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:16.073512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:16.080885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:16.082387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:16.083500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-33c7861e-0f4b-42b6-a0db-3036bab8f7e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072231 Jun 22 19:47:16.084038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 531/869] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:16 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:17.031025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:17.032075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:17.047260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:17.047987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:17.049296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:17.050000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:17.193361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:17.201573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fb7ad999-9cff-4248-a6d5-81310f14dad6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177001 Jun 22 19:47:17.202113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 532/870] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:17.206448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:17.207057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:17.271789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:17.279649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:17.281243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:17.282276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d6e6e0a6-2213-4167-b04b-df5cbdfed80b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079226 Jun 22 19:47:17.282858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 533/871] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:17 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:18.223184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:18.224320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:18.232952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:18.233390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:18.234185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:18.234609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:18.371774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:18.379855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-378d790f-3934-4703-ac61-ead7dd8b6731 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163523 Jun 22 19:47:18.380457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 534/872] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:18 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:18.384801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:18.385385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:18.442938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:18.450058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:18.451537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:18.452659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-75127b6f-feb1-49b2-b394-67e5d5ebbe55 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071342 Jun 22 19:47:18.453209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 535/873] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:18 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:19.400375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:19.400987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:19.408706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:19.409146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:19.409895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:19.410317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:19.546683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:19.554435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dbed886e-b81d-4c4e-83ef-363b4061ad8c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159852 Jun 22 19:47:19.555018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 536/874] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:19.559374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:19.559971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:19.611702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:19.619319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:19.620874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:19.621972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58444e37-66fa-4633-8dbb-46838e5661bf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066046 Jun 22 19:47:19.622524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 537/875] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:19 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:20.573457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:20.574089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:20.581906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:20.582354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:20.583110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:20.583535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:20.716374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:20.724501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c142d393-3c2f-4147-8488-44119d9d6688 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156237 Jun 22 19:47:20.725075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 538/876] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:20.729438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:20.730034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:20.783625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:20.790969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:20.792502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:20.793604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9f46421a-b333-4a2b-b430-3316c712f1eb tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067629 Jun 22 19:47:20.794167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 539/877] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:20 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:21.745730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:21.746920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:21.758750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:21.759202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:21.759968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:21.760433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:21.893583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:21.901250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9b482d8d-a32c-46e0-97c6-07f94441a3f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162150 Jun 22 19:47:21.901818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 540/878] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:21.906317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:21.906910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:21.957141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:21.964864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:21.966356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:21.967457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4c395f7f-8f2c-4cfa-bb4a-3277c7a098d4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064658 Jun 22 19:47:21.968015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 541/879] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:21 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:22.923119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:22.924189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:22.934014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:22.934459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:22.935223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:22.935653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:23.067224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:23.074922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-847d1759-6e5b-4e1c-b636-e66faca8e878 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158544 Jun 22 19:47:23.075485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 542/880] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:23.080000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:23.080623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:23.131508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:23.140418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:23.142532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:23.143647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-11743042-80a0-40e9-aa63-80e05f68882d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067183 Jun 22 19:47:23.144235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 543/881] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:23 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:24.095924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:24.097530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:24.108666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:24.109122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:24.109887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:24.110324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:24.247056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:24.254680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0ce62f5c-47f0-4613-bdd1-3834b019a2fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165167 Jun 22 19:47:24.255242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 544/882] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:24.259637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:24.260195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:24.312679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:24.320232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:24.321765 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:24.322850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4b30a4f9-20f9-4369-9576-2cceca5e157f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066714 Jun 22 19:47:24.323397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 545/883] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:24 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:25.274449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:25.275185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:25.283001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:25.283457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:25.284257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:25.284684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:25.419918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:25.427771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fdc32ab8-8731-4ac0-993c-85594f9e9a03 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158540 Jun 22 19:47:25.428343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 546/884] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:25.432827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:25.433445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:25.483963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:25.491697 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:25.493231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:25.494345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-43f21cc1-8676-4231-a61c-5101afe8dd09 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065094 Jun 22 19:47:25.494902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 547/885] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:25 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:26.449036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:26.450116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:26.462105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:26.462840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:26.464082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:26.464828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:26.609324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:26.619648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58730eec-5f57-43ea-b98d-2115c0494048 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177281 Jun 22 19:47:26.620248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 548/886] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:26.624709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:26.625840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:26.682576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:26.689824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:26.691298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:26.692421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e5a26340-e1bb-4315-ba08-fe2c3ddd4adc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071238 Jun 22 19:47:26.692978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 549/887] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:26 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:27.640865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:27.641880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:27.652169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:27.652544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:27.653294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:27.653717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:27.781413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:27.789609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1e5d5656-b617-407d-bf51-c7e8977b3977 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155138 Jun 22 19:47:27.790137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 550/888] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:27.794644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:27.795241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:27.849267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:27.856602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:27.858072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:27.859194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3540dd3c-2604-424e-adfe-38b983e0d7ff tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068135 Jun 22 19:47:27.859753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 551/889] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:27 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:28.810793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:28.811802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:28.823060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:28.823509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:28.824325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:28.824757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:28.961741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:28.970162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-270925e6-0455-4c6e-932a-00f88137006c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165944 Jun 22 19:47:28.970744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 552/890] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:28.975564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:28.976219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:29.036793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:29.044691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:29.046190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:29.047304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fa6f2a82-8ff5-4f8b-94df-34caf70beb4c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075637 Jun 22 19:47:29.047868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 553/891] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:28 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:29.990946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:29.992023 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:30.004202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:30.004932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:30.006196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:30.006916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:30.025802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:30.144500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:30.154137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e6b2b2ea-2794-450a-9ff3-a2c8917bb68d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169892 Jun 22 19:47:30.154716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 554/892] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:30.160923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:30.161968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:30.213260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:30.220864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:30.222666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:30.223756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d04d90ba-01a1-4e2e-898b-26e5d66d1ce1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068151 Jun 22 19:47:30.224338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 555/893] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:30 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:31.178975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:31.180086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:31.191057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:31.191554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:31.192452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:31.192931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:31.329515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:31.337935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8c363e24-840f-4c73-9128-4ff157334ae7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165546 Jun 22 19:47:31.338563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 556/894] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:31.346926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:31.346926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:31.346926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:31.398279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:31.406062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:31.407550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:31.408716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3dccaffb-afbc-4376-ac93-8c157d5af63f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069232 Jun 22 19:47:31.409282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 557/895] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:31 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:32.358203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:32.359001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:32.366468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:32.366961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:32.367806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:32.368323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:32.511307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:32.519364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3b756d37-4ad6-428f-971c-980d0770c6ba tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166427 Jun 22 19:47:32.519930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 558/896] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:32.524393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:32.524991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:32.574846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:32.582564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:32.584078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:32.585242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f97090cd-f6c4-49df-b5c9-70a38e23cade tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064337 Jun 22 19:47:32.585793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 559/897] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:32 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:33.540449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:33.541525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:33.555623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:33.556863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:33.558070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:33.558511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:33.693252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:33.702847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bddeafbe-e985-4e0c-b604-ed7edd2d1476 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168852 Jun 22 19:47:33.703426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 560/898] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:33.707824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:33.708449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:33.759006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:33.766594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:33.768090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:33.769255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2efe9417-1a90-4578-b802-605d338cc397 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064891 Jun 22 19:47:33.769818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 561/899] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:33 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:34.723589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:34.724318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:34.732347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:34.732800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:34.733565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:34.733994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:34.869439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:34.880368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1d04831-d43e-4dd7-97f8-97da05c3d2e8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163510 Jun 22 19:47:34.881159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 562/900] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:34.885694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:34.886293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:34.943316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:34.950542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:34.952039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:34.953177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e13b6473-97c5-48ce-b84e-a0de4a2fd4e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071064 Jun 22 19:47:34.953756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 563/901] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:34 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:35.901749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:35.902518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:35.911054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:35.911570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:35.912493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:35.912995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:36.052691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:36.060281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4733aedf-88ed-4749-b9e3-267bd79ec577 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165030 Jun 22 19:47:36.060847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 564/902] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:35 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:36.065207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:36.065800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:36.115553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:36.122940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:36.124439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:36.125532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-11fd52f2-8021-4661-a613-39d474d5687c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063768 Jun 22 19:47:36.126077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 565/903] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:37.081207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:37.082224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:37.092451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:37.092903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:37.093671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:37.094101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:37.226069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:37.233778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cd279a5d-21df-4994-bf56-a8886bfa1a21 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159044 Jun 22 19:47:37.234354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 566/904] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:37.238756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:37.239356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:37.289732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:37.297049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:37.298548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:37.299657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8164d718-453c-4954-839f-279f8a85b554 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064387 Jun 22 19:47:37.300203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 567/905] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:38.254850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:38.255981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:38.267404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:38.267864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:38.268664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:38.269091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:38.419149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:38.426887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0d9bdcd4-4246-49c4-b6a0-97b6abbabcd6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.178569 Jun 22 19:47:38.427457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 568/906] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:38.431917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:38.432542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:38.487980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:38.495571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:38.497111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:38.498224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5d382307-9639-4b08-8fd2-a86989583fda tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069880 Jun 22 19:47:38.498809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 569/907] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:38 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:39.445649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:39.446387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:39.455618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:39.456234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:39.457201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:39.457734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:39.589410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:39.598138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9f1e17d1-dab8-40d6-8ca6-fe69f19f793f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157362 Jun 22 19:47:39.610144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 570/908] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:39.610144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:39.610144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:39.654531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:39.661852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:39.663344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:39.664477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-04dc6d64-a4fb-4df3-8705-8c2b9f7ca4aa tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064734 Jun 22 19:47:39.665048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 571/909] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:39 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:40.621788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:40.622748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:40.635101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:40.635799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:40.636615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:40.637043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:40.781795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:40.792770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-abdb3c55-f77b-4097-917e-13eaecceb1aa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.176663 Jun 22 19:47:40.793352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 572/910] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:40.797948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:40.798546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:40.849723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:40.857305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:40.858794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:40.859890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4532b164-e5d2-4262-a2da-a0ddb7fe2061 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065605 Jun 22 19:47:40.860491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 573/911] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:40 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:41.814485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:41.815522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:41.827675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:41.828496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:41.829756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:41.830478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:41.963699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:41.971397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-29bb2914-42d8-4f2f-95a4-2823fbf73455 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163512 Jun 22 19:47:41.972267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 574/912] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:41 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:41.976784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:41.977360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:42.031495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:42.038718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:42.040220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:42.041340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4155fd50-8e44-4628-8b7d-783e80580e10 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068113 Jun 22 19:47:42.042016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 575/913] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:42.992786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:42.993887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:43.006170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:43.006918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:43.008193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:43.008934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:43.145407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:43.153374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-225e3031-9e96-4051-87e6-db57d55de0e9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167021 Jun 22 19:47:43.153944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 576/914] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:43.158471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:43.159075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:43.209345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:43.216740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:43.218234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:43.219336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8f1f2f87-0d42-4ec7-9f91-35491922386f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064485 Jun 22 19:47:43.219897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 577/915] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:44.174576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:44.175660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:44.187648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:44.188450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:44.189695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:44.190401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:44.338410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:44.350119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-26553e86-6f97-4f62-b06c-c1711961ba29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.181744 Jun 22 19:47:44.350860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 578/916] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:44 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:44.355301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:44.355898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:44.406468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:44.408684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=54 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:44.415129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:44.416710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:44.417839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3632e44c-b3e2-4bbe-83da-9497690e4d60 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066085 Jun 22 19:47:44.418396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 579/917] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:44 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:45.369565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:45.370404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:45.382714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:45.383341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:45.384464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:45.385035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:45.519239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:45.527065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-868813fd-c001-42ab-9921-4a76c978a45e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162719 Jun 22 19:47:45.527607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 580/918] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:45.532070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:45.532706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:45.585736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:45.593138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:45.594608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:45.595714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c880e0b6-ae8a-4481-bb96-64148cded3bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067172 Jun 22 19:47:45.596336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 581/919] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:46.544522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:46.545228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:46.553733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:46.554176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:46.554931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:46.555354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:46.697796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:46.706902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58255b0b-a31f-4618-88e2-3e6a8f284470 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166217 Jun 22 19:47:46.707709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 582/920] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:46.712126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:46.712710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:46.776508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:46.784013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:46.785540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:46.786643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cdcc3d74-d62c-4758-ac71-3d7cac7c79b8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077978 Jun 22 19:47:46.787176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 583/921] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:47.724036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:47.724732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:47.732344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:47.732790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:47.733560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:47.733988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:47.867478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:47.875815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f567a527-ae0a-4a19-a000-f79667d45776 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155964 Jun 22 19:47:47.876425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 584/922] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:47.881011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:47.881608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:47.936621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:47.943681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:47.945203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:47.946301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-51a183b3-1d11-42a8-bfee-e32bbd427b5d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068970 Jun 22 19:47:47.946848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 585/923] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:47 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:48.897236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:48.898190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:48.910352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:48.911131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:48.912443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:48.913179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:49.045316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:49.053307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6f163483-6aa6-44bb-bc26-3e6c04946954 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162824 Jun 22 19:47:49.053882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 586/924] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:49.058303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:49.058907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:49.112711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:49.121453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:49.123037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:49.124139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-81058bc1-a254-4036-879d-2ad46cf397ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069323 Jun 22 19:47:49.124751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 587/925] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:50.070613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:50.071229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:50.078635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:50.079083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:50.079842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:50.080311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:50.084291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:50.217097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:50.225621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-47a8d00d-c732-4df1-be6b-9e3bfb9d45ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158869 Jun 22 19:47:50.226171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 588/926] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:47:50.230854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:50.231452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:50.295986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:50.305795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:50.307931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:50.309616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0d853837-d051-427d-81e3-0d3954f6eb2a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082250 Jun 22 19:47:50.310425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 589/927] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:50 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:51.249967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:51.251069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:51.256495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:47:51.262652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:51.263094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:51.263825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:51.264347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:51.404972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:51.414648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af848443-e95a-4e51-8ca6-d8a216af26ec tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170931 Jun 22 19:47:51.415385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 590/928] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:51.419803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:51.420440 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:51.474112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:51.481700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:51.483178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:51.484313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13f2467e-28f4-4ee8-b090-fe34392f3f14 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067991 Jun 22 19:47:51.484834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 591/929] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:51 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:52.436168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:52.437378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:52.450595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:52.451042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:52.451800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:52.452264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:52.583437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:52.595449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c8f521ea-ff10-4346-8072-0936831622ad tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165430 Jun 22 19:47:52.596299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 592/930] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:52.603544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:52.604243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:52.657559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:52.664976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:52.666572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:52.667667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-305324d0-6d77-4ce1-9ff0-4b2a92824f04 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069938 Jun 22 19:47:52.668242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 593/931] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:52 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:53.615554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:53.616359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:53.623800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:53.624286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:53.625040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:53.625480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:53.762357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:53.769988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b1c29285-220e-4c84-b186-d02057ea18f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158296 Jun 22 19:47:53.770597 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 594/932] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:47:53.775006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:53.775724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:53.826838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:53.833944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:53.835435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:53.836623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-526b1d21-58b1-4d09-83ce-085502c0ea54 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065098 Jun 22 19:47:53.837340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 595/933] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:53 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:54.791268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:54.792095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:54.801497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:54.802057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:54.803233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:54.803871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:54.942015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:54.950165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ab1f9603-07eb-4513-811b-5899f682b48e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165472 Jun 22 19:47:54.950739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 596/934] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:54 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:54.955120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:54.955725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:55.010946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:55.021722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:55.023756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:55.024889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-87f0393e-2436-4978-b8ca-b267d26398e3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073270 Jun 22 19:47:55.025466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 597/935] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:54 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:55.970966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:55.972473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:55.984513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:55.985274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:55.986798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:55.987513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:56.121763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:56.132967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-77b956d3-4afe-4fd6-b553-7ca59a9a493a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168247 Jun 22 19:47:56.133779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 598/936] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:56.140446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:56.141254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:56.199165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:56.210175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:56.212347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:56.213965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c936cbd0-0fde-43b4-bcb2-dd2a018224cd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078920 Jun 22 19:47:56.214699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 599/937] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:56 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:57.158507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:57.159640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:57.169755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:57.170209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:57.170988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:57.171421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:57.314565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:57.326296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dc8db40c-450c-4764-852d-c4244eac2249 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.174118 Jun 22 19:47:57.327066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 600/938] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:57.331390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:57.331951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:57.383143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:57.390750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:57.392265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:57.393360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0bbdfcc5-5041-48e4-a11c-15e9bd476d1f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065394 Jun 22 19:47:57.393915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 601/939] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:57 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:58.345419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:58.346109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:58.353882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:58.354335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:58.355139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:58.355571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:58.495019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:58.502955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9e38f9eb-c447-4eab-b931-df976e1fcae9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161594 Jun 22 19:47:58.503528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 602/940] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:58.507994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:58.508681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:58.558396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:58.565761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:58.567270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:58.568402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3caaa3ee-b9fe-4496-a74f-1efa40d9320a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063930 Jun 22 19:47:58.568958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 603/941] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:58 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:47:59.523722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:59.524718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:59.534604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:59.535048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:59.535813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:47:59.536280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:47:59.667107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:59.678619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-20f7d65e-9755-45d3-83ab-032a9ef1e446 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161177 Jun 22 19:47:59.679396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 604/942] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:47:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:47:59.683933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:47:59.684533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:47:59.737737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:59.745408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:59.746917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:47:59.748033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-494c1f5d-c89c-420a-801d-63edbcb640a0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067720 Jun 22 19:47:59.748644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 605/943] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:47:59 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:00.700172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:00.701147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:00.713112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:00.713905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:00.715169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:00.715976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:00.857693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:00.869140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fe29dcae-7f91-4730-89a3-f51bdef502e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175239 Jun 22 19:48:00.869897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 606/944] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:00.877091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:00.877807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:00.929751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:00.937253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:00.938724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:00.939842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-02a7d289-9949-44cb-a17c-d2d0f42e7fa6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068765 Jun 22 19:48:00.940438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 607/945] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:00 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:01.894866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:01.895960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:01.905474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:01.905922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:01.906684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:01.907146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:02.039705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:02.047411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5b49835b-8c44-48b9-89d3-d9e0b44fe0f2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159070 Jun 22 19:48:02.047985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 608/946] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:02.052470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:02.053102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:02.102991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:02.110483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:02.112012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:02.113130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9b8ba892-9106-464a-823c-c83819884290 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064120 Jun 22 19:48:02.113704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 609/947] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:02 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:03.068952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:03.069998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:03.078477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:03.078926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:03.079693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:03.080147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:03.208956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:03.216973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e89c9afd-13a7-48cc-b903-085a759191a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.154700 Jun 22 19:48:03.217542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 610/948] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:03.222264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:03.222864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:03.282866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:03.293817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:03.296390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:03.298204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c3d42d7e-2968-4f1f-9218-3279d7df170e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079454 Jun 22 19:48:03.299054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 611/949] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:03 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:04.238056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:04.239216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:04.247647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:04.248071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:04.248890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:04.249320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:04.387540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:04.396253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7832de82-a2cf-4fec-986c-3a5fa48e99d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.164635 Jun 22 19:48:04.396822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 612/950] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:04.401310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:04.401938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:04.452627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:04.461260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:04.463290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:04.465223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-de3b15b8-62cb-4ad3-92e3-cb85aafd82bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067160 Jun 22 19:48:04.466395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 613/951] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:04 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:05.417538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:05.418463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:05.430385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:05.431118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:05.432425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:05.433129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:05.571463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:05.583184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-163d8226-9330-47f6-800d-990866295711 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171934 Jun 22 19:48:05.583960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 614/952] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:05.589681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:05.590269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:05.643849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:05.653595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:05.655101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:05.656247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6328e077-faa1-48c7-803d-5be7d82b8fc1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071172 Jun 22 19:48:05.656778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 615/953] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:05 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:06.606375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:06.607421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:06.621409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:06.621855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:06.622616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:06.623079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:06.761660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:06.769547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a41ae789-ef61-4b6a-ac6e-43ae20d2ec35 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169806 Jun 22 19:48:06.770116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 616/954] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:06.774587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:06.775197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:06.829616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:06.837627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:06.839129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:06.840251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0002f7e8-caac-4062-95b1-f92c2b9e0342 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069200 Jun 22 19:48:06.840804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 617/955] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:06 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:07.790810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:07.791857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:07.803916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:07.804726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:07.805990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:07.806876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:07.937121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:07.945295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ab4c6445-495f-4d21-9524-92f2c301c9b3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161046 Jun 22 19:48:07.945872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 618/956] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:07.950486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:07.951092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:08.002388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:08.009834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:08.011327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:08.012457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3c5e68b6-95b2-4729-9e31-049054a71775 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065639 Jun 22 19:48:08.013014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 619/957] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:07 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:08.967175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:08.968254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:08.980126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:08.980588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:08.981355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:08.981790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:09.116729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:09.121836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:09.129020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7a1ebfae-8be6-4747-8519-d7801aca580f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168428 Jun 22 19:48:09.129867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 620/958] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:09.136122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:09.136724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:09.188445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:09.196321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:09.197945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:09.199051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-537edceb-5e6a-4fed-bc30-fd6cbb70215c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068252 Jun 22 19:48:09.199609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 621/959] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:09 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:10.152371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:10.153449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:10.164415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:10.165152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:10.166768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:10.167892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:10.307300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:10.316128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61d0e9e3-e5d6-4107-a044-b89a2bbcd651 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170477 Jun 22 19:48:10.316754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 622/960] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:10.321145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:10.321743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:10.328641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:10.376516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:10.383683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:10.385307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:10.386414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b088cffc-2607-47ad-9ae4-7b988774fc25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068751 Jun 22 19:48:10.386970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 623/961] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:10 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:10.951378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5fabfe4c-5bf5-4ee6-a9c6-0c172317083e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "POST /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 221.763467 Jun 22 19:48:10.952454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 339/962] 10.222.0.26 () {62 vars in 1363 bytes} [Wed Jun 22 19:44:29 2022] POST /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077/os-volume_attachments => generated 188 bytes in 221765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 19:48:11.332552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:11.333166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:11.340738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:11.341207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:11.341967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:11.342424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:11.405039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:11.405655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:11.472705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:11.478545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:11.481872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:11.483545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:11.485440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d6742408-c7ba-4bc5-befc-2a05df0f14b4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.084903 Jun 22 19:48:11.488631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c6d7f236-b340-49c5-8624-9392eab73cf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159903 Jun 22 19:48:11.489311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 624/963] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:11.496229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 340/964] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:11 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:48:12.503443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:12.504628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:12.506312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:12.506857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:12.515372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:12.516068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:12.517390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:12.518128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:12.565636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:12.573084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:12.574719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:12.575833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-668d9f49-6842-4d78-b13a-105f4e0fd225 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076475 Jun 22 19:48:12.576417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 625/965] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:12 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:12.654308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:12.662496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ae50567c-1061-4caa-901b-5f9dc3316d74 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160023 Jun 22 19:48:12.663041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 341/966] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:13.599053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:13.600045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:13.653762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:13.663550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:13.666036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:13.667145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-150726c1-9306-4a15-846b-8af8a8ba42b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075147 Jun 22 19:48:13.667703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 626/967] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:13 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:13.678992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:13.679509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:13.686518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:13.686967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:13.687732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:13.688196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:13.819552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:13.831793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2be5adf6-8c6c-434b-8921-023593425e45 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156499 Jun 22 19:48:13.832593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 342/968] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:14.689269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:14.690330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:14.753949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:14.756134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=50 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:14.762065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:14.763564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:14.764723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7a859e8c-e47e-4ff2-a578-ba3a52a28025 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082034 Jun 22 19:48:14.765282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 627/969] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:14.855671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:14.856746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:14.869408 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:14.869851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:14.870628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:14.871059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:15.018063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:15.029719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-52ba20bf-608a-45f0-ab13-13026a7d7c10 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.180302 Jun 22 19:48:15.030480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 343/970] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:15.790706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:15.791456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:15.848903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:15.856571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:15.858065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:15.859176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c9c736b9-7f09-4cfc-b180-f48def3b07ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075360 Jun 22 19:48:15.859742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 628/971] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:15 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:16.057978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:16.059042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:16.066488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:16.066933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:16.067694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:16.068136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:16.202629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:16.210518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4732d691-a108-44e5-941f-a68054c8b150 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162111 Jun 22 19:48:16.211188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 344/972] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:16.881525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:16.882359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:16.947613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:16.955358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:16.956880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:16.957976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-75035caf-cde5-4179-a418-4f59a6ba98f8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.083215 Jun 22 19:48:16.958522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 629/973] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:16 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:17.232456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:17.233508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:17.244548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:17.245294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:17.246535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:17.247241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:17.396914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:17.408452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3be9ca82-980a-4d98-a088-f766ac88914c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.182249 Jun 22 19:48:17.409310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 345/974] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:17.980905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:17.981882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:18.054684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:18.061946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:18.063446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:18.064720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ba3c077f-dd3f-4906-83de-ae859cd501bd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.090665 Jun 22 19:48:18.065284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 630/975] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:17 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:18.429337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:18.430200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:18.437758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:18.438231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:18.439026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:18.439478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:18.586182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:18.594979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-82678a9f-2210-47a5-a67a-bc313ab0c79c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.172157 Jun 22 19:48:18.595552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 346/976] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:18 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:19.089220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:19.090149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:19.155893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:19.163498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:19.165028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:19.166165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d0fdfd38-2aad-4386-ba5e-c1c66f646d13 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.083623 Jun 22 19:48:19.166749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 631/977] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:19 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:19.614590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:19.615341 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:19.623514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:19.624075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:19.625051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:19.625588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:19.757789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:19.765773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a3939819-16a0-44f8-908a-6199a58ef943 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156166 Jun 22 19:48:19.766318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 347/978] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:48:20.194202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:20.195197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:20.249657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:20.257395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:20.258872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:20.259999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e730b86b-5674-4669-a22c-8358823dd7ab tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072334 Jun 22 19:48:20.260576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 632/979] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:20 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:20.786157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:20.787007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:20.798201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:20.798948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:20.800216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:20.800971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:20.941693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:20.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4091f48f-f6af-4017-9829-3a21cd3ae9f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171362 Jun 22 19:48:20.951550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 348/980] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:21.278980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:21.279552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:21.337472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:21.345252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:21.347537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:21.349084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0232fe3c-8cf5-4af9-a41d-35927fe61c28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074225 Jun 22 19:48:21.349828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 633/981] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:21 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:21.972446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:21.973642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:21.976570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:21.983452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:21.983929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:21.984729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:21.985157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:22.118389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:22.126243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-114ebde6-51fc-4619-adc5-bf8f802305ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160624 Jun 22 19:48:22.126797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 349/982] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:22.371470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:22.372004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:22.373860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=12 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:22.426957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:22.437879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:22.440154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:22.441770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-327b9b7c-f8c9-45f5-9c61-e810999f2988 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075414 Jun 22 19:48:22.442511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 634/983] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:22 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:23.147323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:23.148447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:23.156512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:23.157000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:23.157824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:23.158289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:23.294395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:23.302135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3525aa29-4dfb-4789-a1ec-8eb8271d88af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161180 Jun 22 19:48:23.302701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 350/984] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:23.464146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:23.465393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:23.525500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:23.533249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:23.534750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:23.535879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-30ee1f62-a55e-4d71-b4c6-88c499502c42 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078324 Jun 22 19:48:23.536466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 635/985] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:23 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:24.322841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:24.323789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:24.332679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:24.333113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:24.334119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:24.334820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:24.481999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:24.490011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-77a0356d-5dee-45eb-b4fc-480e99c4170f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.173675 Jun 22 19:48:24.490592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 351/986] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:24.553949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:24.554503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:24.606984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:24.614448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:24.615905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:24.617045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-638bbfdb-55e7-48a3-86ae-a7e78e5cc2f3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067082 Jun 22 19:48:24.617593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 636/987] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:24 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:25.507228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:25.507861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:25.515142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:25.515619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:25.516421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:25.516855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:25.636406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:25.637001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:25.647730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:25.655402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-270de559-5d72-4fb9-a366-7e4f48e62c7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.152208 Jun 22 19:48:25.656005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 352/988] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:25.688991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:25.696475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:25.698086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:25.699195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0c4e2c60-338e-4bc5-bb9e-4900d395fd66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066900 Jun 22 19:48:25.699797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 637/989] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:25 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:26.676990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:26.677815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:26.686064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:26.686518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:26.687286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:26.687718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:26.717135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:26.717740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:26.770909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:26.778498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:26.780033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:26.781245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6f7c996d-5b64-447a-88a9-9fa5d658b445 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067983 Jun 22 19:48:26.781809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 638/990] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:26 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:26.821820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:26.829591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c3e59406-560e-4f1d-ada0-008153751a0f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159425 Jun 22 19:48:26.830206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 353/991] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:27.800206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:27.800890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:27.847390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:27.847979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:27.854799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:27.855288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:27.856128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:27.856579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:27.994105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:28.002228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3f5ab2f6-094a-487a-8f48-29eb21201e7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159085 Jun 22 19:48:28.002822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 354/992] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:48:28.091825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:28.103230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:28.105480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:28.106991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a262e3cb-f55b-46ca-8c18-b63815a20cf5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.311404 Jun 22 19:48:28.107820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 639/993] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:27 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:29.023585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:29.024632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:29.032807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:29.033335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:29.034219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:29.034726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:29.125341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:29.125980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:29.174567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:29.178571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:29.182829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37f87df5-6f5a-4ccf-b312-13a2d019322e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165558 Jun 22 19:48:29.183419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 355/994] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:29.186032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:29.187541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:29.188682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1788bc78-68b1-4ed4-a556-623215f95ab8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067291 Jun 22 19:48:29.189233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 640/995] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:29 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:48:30.204170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:30.205204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:30.209475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:30.210433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:30.215944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:30.216721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:30.217981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:30.218692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:30.269783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:30.277467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:30.278968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:30.280054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a6f27148-c02a-440a-93b1-80a098cbac63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077090 Jun 22 19:48:30.280866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 641/996] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:30 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:30.355179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:30.358544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:30.368240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42f62c53-eb49-4aed-8689-4174778e75bc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170332 Jun 22 19:48:30.368974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 356/997] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:30 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:31.302260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:31.303224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:31.356750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:31.364002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:31.365516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:31.366609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ddde7a15-b0e6-4b65-a165-29dd850d1572 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071039 Jun 22 19:48:31.367163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 642/998] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:31 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:31.385943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:31.386536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:31.393372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:31.393812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:31.394558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:31.395003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:31.538007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:31.545655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bb688e60-78ab-4da4-b6c3-f727221d3d7a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163871 Jun 22 19:48:31.546220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 357/999] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:32.387612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:32.388705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:32.464069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:32.472297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:32.473899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:32.475060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-22276c3b-0b93-40e0-9996-11de648e3acc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.093412 Jun 22 19:48:32.475669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 643/1000] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:32 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:32.566635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:32.567628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:32.578571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:32.579311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:32.580773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:32.581482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:32.725377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:32.737212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c622a95f-a4c0-47c7-b4a8-91b56ea5978c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.176809 Jun 22 19:48:32.737969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 358/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:33.493988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:33.494622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:33.547116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:33.554716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:33.556362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:33.557459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b210947c-e9d8-4675-a290-a9c6b0861f57 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067758 Jun 22 19:48:33.558012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 644/1002] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:33 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:33.756830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:33.757592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:33.764819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:33.765258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:33.765999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:33.766420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:33.905121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:33.912789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d84fa864-1a94-438c-9b76-e61b2b924248 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161081 Jun 22 19:48:33.913361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 359/1003] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:34.579906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:34.580988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:34.690797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:34.698204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:34.700441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:34.702133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ceb7ad58-3df8-4066-8071-eff895ee7a8d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.128835 Jun 22 19:48:34.703027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 645/1004] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:34 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:48:34.933865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:34.934537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:34.942921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:34.943484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:34.944476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:34.945015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:35.136924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:35.144693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6962283f-d9da-4098-bb1b-482acb94a32c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.216916 Jun 22 19:48:35.145262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 360/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:35.723747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:35.724792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:35.785785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:35.793833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:35.795326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:35.796960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a2667938-d24a-4eed-8de4-f9842a7ea19a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.080017 Jun 22 19:48:35.797510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 646/1006] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:35 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:36.164289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:36.165171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:36.172208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:36.172655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:36.173416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:36.173846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:36.312797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:36.324774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-68b091a2-bbfe-45db-9d2b-21f36eec22c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165464 Jun 22 19:48:36.325556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 361/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:36.819241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:36.820525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:36.881456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:36.889529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:36.891017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:36.892122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2fd83876-8eb5-4098-8e7b-88fd1f023eee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077461 Jun 22 19:48:36.892691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 647/1008] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:37.350855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:37.351958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:37.362728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:37.363511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:37.364874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:37.365585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:37.500325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:37.508280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-32d49341-9e35-4878-a8d5-b0935c7e9ed5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.164292 Jun 22 19:48:37.508892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 362/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:37.910583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:37.911186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:37.963327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:37.970737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:37.972595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:37.973688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55d93bec-604e-4090-ae5e-56b54ba42f45 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067114 Jun 22 19:48:37.974248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 648/1010] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:38.527576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:38.528203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:38.535059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:38.535500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:38.536296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:38.536729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:38.674707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:38.682667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b9b32d95-f2c8-4f69-917c-54e3c64cd65c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159841 Jun 22 19:48:38.683211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 363/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:38.994833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:38.995836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:39.001156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:39.053233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:39.060594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:39.062098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:39.063203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-82b3aac8-671d-4942-9fc7-f606949489b3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074937 Jun 22 19:48:39.063756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 649/1012] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:38 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:39.703779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:39.704805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:39.708437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=51 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:39.717571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:39.718331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:39.719550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:39.720313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:39.861259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:39.872977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7bcfe194-460a-4b3b-b165-0acaabb75bc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175256 Jun 22 19:48:39.873746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 364/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:40.082146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:40.082768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:40.135462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:40.143051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:40.144579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:40.145672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-134b5c16-8f91-415a-9d02-bf3d6b32d379 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068363 Jun 22 19:48:40.146217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 650/1014] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:40 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:40.898342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:40.899265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:40.906353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:40.906793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:40.907533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:40.907952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:41.042955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:41.051189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-35ad5ed2-bac6-4e8b-bcee-b94c1a993ea5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159451 Jun 22 19:48:41.051738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 365/1015] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:41.166318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:41.166851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:41.224387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:41.233715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:41.235214 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:41.236362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-efa8c7ec-5c16-4038-9e4e-3133c4da3a63 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076056 Jun 22 19:48:41.236970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 651/1016] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:42.072469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:42.073505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:42.084691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:42.085426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:42.086652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:42.087357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:42.232393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:42.244937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6244a68d-8d49-4350-b1d5-ad8939ad5d1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.178628 Jun 22 19:48:42.245811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 366/1017] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:42.254129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:42.254740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:42.306887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:42.314151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:42.315647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:42.316787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4fb5d3ad-724a-4ad1-953e-65c0532331d2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066589 Jun 22 19:48:42.317345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 652/1018] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:42 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 19:48:43.265129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:43.265825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:43.273716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:43.274275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:43.275095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:43.275521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:43.339985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:43.340755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:43.411052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:43.418953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1f438d7d-023f-4437-984a-0801bc1a9ce4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158784 Jun 22 19:48:43.419731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 367/1019] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:43.433450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:43.440665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:43.442167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:43.443247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4a85cee3-0675-4385-bd3e-8262fa1d33f5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.107291 Jun 22 19:48:43.443781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 653/1020] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:44.334170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:48:44.334639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:48:44.436439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:44.437040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:44.443880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:44.444350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:44.445128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:44.445554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:44.461954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:44.462530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:44.517480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:44.524827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:44.526315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:44.527417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8787eaa9-32a9-42e3-b8aa-b208559671a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069852 Jun 22 19:48:44.527970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 654/1021] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:44 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:44.576550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:44.588323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e9ce8a3-4e58-404f-a863-a6bfa8ffa43c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155724 Jun 22 19:48:44.588855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 368/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:44 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:45.549670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:45.550715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:45.606372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:45.607520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:45.607669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:45.614401 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:45.614843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:45.615205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:45.615599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:45.616020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:45.616848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:45.617986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d46c4a99-bd3e-4e00-afcf-a4b17afee7d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075170 Jun 22 19:48:45.618509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 655/1023] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:45.755755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:45.763919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e1878063-d36e-4ed8-9af7-c5703f36cb77 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161444 Jun 22 19:48:45.764537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 369/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:46.638125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:46.639010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:46.693448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:46.695667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=58 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:46.702235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:46.703788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:46.704934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-df7e9bc7-085b-4f3b-8f7b-51658a66eda9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071371 Jun 22 19:48:46.705456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 656/1025] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:46.781170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:46.782488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:46.790462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:46.791770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:46.792739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:46.793371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:47.031366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:47.039932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6f2d85da-63a9-4ce2-ac00-f5796512c79b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.262644 Jun 22 19:48:47.040691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 370/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:47.724016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:47.724648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:47.776181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:47.786178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:47.788471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:47.790029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4ddb0557-d454-4b42-9aee-03c468c7c765 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070511 Jun 22 19:48:47.790941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 657/1027] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:47 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:48.063702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:48.064697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:48.073918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:48.074373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:48.075132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:48.075565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:48.229664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:48.237766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c860e69a-000a-420e-a3cb-9ec094f8d04b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.180684 Jun 22 19:48:48.238308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 371/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:48.811975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:48.812971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:48.868760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:48.876398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:48.877911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:48.879019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5878dd86-f4ff-4092-ad57-458c28e4fafc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073877 Jun 22 19:48:48.879576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 658/1029] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:48 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:49.263930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:49.265034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:49.275174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:49.275617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:49.276397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:49.276829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:49.417297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:49.425296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d1610df2-41cd-4022-9f0c-64489a25a6d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167761 Jun 22 19:48:49.425842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 372/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:49.902992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:49.903920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:49.976841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:49.984224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:49.985702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:49.986789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-da3b0201-6134-444a-b548-f06b48e3222c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.090617 Jun 22 19:48:49.987335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 659/1031] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:50.446435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:50.447135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:50.454404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:50.454963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:50.455777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:50.456280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:50.473185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:48:50.603688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:50.611897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3e9ab3ff-3fb3-45f9-8dda-5f8217b85b5c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171995 Jun 22 19:48:50.612504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 373/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:51.008459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:51.009202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:51.067138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:51.074797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:51.076314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:51.077409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-041b2a6a-a596-42fe-a7c5-8c37f02e2a3e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075648 Jun 22 19:48:51.077951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 660/1033] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:51 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:51.629043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:51.629628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:51.636282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:51.636728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:51.637471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:51.637892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:51.775423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:51.783008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3b06b9ec-7a49-44ab-90ac-c13aa80dd5ab tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157841 Jun 22 19:48:51.783617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 374/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:52.100430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:52.101426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:52.160226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:52.167623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:52.169151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:52.170244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9d9ce8fc-ac3d-4e8d-8c81-e0bc4db2e124 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076656 Jun 22 19:48:52.170784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 661/1035] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:52 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:52.804292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:52.805142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:52.811979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:52.812454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:52.813196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:52.813621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:52.949459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:52.957047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a1d1eecb-2969-4d1f-a2a4-233930fc3762 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159433 Jun 22 19:48:52.957616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 375/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:53.193512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:53.194483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:53.250067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:53.260335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:53.261817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:53.262907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c0eac468-ed74-44d0-ad9e-bed1220eb2d9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076975 Jun 22 19:48:53.263454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 662/1037] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:53 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:53.978140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:53.978853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:53.986403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:53.986897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:53.987734 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:53.988231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:54.127402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:54.135286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-769794ac-6871-407c-a17f-8a08504c7f09 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163745 Jun 22 19:48:54.135863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 376/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:54.285149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:54.286019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:54.349080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:54.356640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:54.358136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:54.359233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1e70a71b-c5a3-4c06-80fc-62c9bef971da tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.080866 Jun 22 19:48:54.359782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 663/1039] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:54 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:54.711244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:48:54.711650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:48:55.156589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:55.157604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:55.168464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:55.169208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:55.170456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:55.171170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:55.310499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:55.318706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6861e71b-1cbe-432e-be46-ef7ac56e17bd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168711 Jun 22 19:48:55.319270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 377/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:55.383453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:55.384038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:55.442197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:55.449860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:55.451347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:55.452469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0e50056b-c428-45c1-aa97-1271ff4e97d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075437 Jun 22 19:48:55.453040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 664/1041] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:55 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:56.348546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:56.349508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:56.357501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:56.357943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:56.358690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:56.359109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:56.471346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:56.472071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:56.501792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:56.509986 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24b83c7f-75ae-4652-b864-816ef11ed80a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169371 Jun 22 19:48:56.515277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 378/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:56.524963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:56.532272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:56.533768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:56.534873 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2bc06f60-6f6b-4fd7-afbe-44a2cc259e25 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068090 Jun 22 19:48:56.535430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 665/1043] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:56 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:57.531060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:57.532068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:57.542839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:57.543575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:57.544903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:57.545612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:57.556616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:57.557392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:57.611046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:57.618623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:57.620418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:57.621556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-74f91f37-0199-491f-941a-ff58c9744a90 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071601 Jun 22 19:48:57.622111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 666/1044] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:57 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:57.677901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:57.685648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5758c27c-33fe-4821-9f91-6aabbf6db020 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161123 Jun 22 19:48:57.686217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 379/1045] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:58.643770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:58.644793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:58.702792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:58.703391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:58.706623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:58.710620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:58.711069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:58.712048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:58.712393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:58.713964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:58.715435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:58.716549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e2fcb214-b6ce-4cd4-92f7-ce6a9b73bbf9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079320 Jun 22 19:48:58.717091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 667/1046] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:58 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:58.868849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:58.877060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-982de96e-26ca-4646-bee2-e704b72e82f5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.178185 Jun 22 19:48:58.877631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 380/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:48:59.742427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:59.743326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:59.796758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:59.804259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:59.805884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:48:59.806973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-35cd72eb-e8e7-4353-adc2-0a8b19e794ef tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071200 Jun 22 19:48:59.807519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 668/1048] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:48:59 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:48:59.906661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:48:59.907581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:48:59.917491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:59.917929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:48:59.918683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:48:59.919111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:00.054076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:00.065484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6e33225b-7188-4d1a-acfb-6d31376cfae6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165084 Jun 22 19:49:00.066251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 381/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:48:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:00.825947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:00.826492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:00.880571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:00.888041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:00.889554 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:00.890647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9667c94c-582a-4d42-a354-76ddf95bcc28 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068740 Jun 22 19:49:00.891190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 669/1050] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:00 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:01.087829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:01.088408 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:01.095310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:01.095759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:01.096883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:01.097314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:01.227386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:01.235362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-efe2f94e-77bc-4823-bc4e-331d920d51c1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.153727 Jun 22 19:49:01.235928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 382/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:01.913175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:01.914051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:01.972684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:01.979971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:01.981488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:01.982581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-629d040a-d5f8-465c-bc9a-2d52966bce47 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076312 Jun 22 19:49:01.983129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 670/1052] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:01 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:02.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:02.257721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:02.264960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:02.265412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:02.266169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:02.266637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:02.399040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:02.407111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ed6a7fce-6c93-44c6-9e82-3f2f27917a1e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157064 Jun 22 19:49:02.407682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 383/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:03.004611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:03.005541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:03.065729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:03.073529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:03.075058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:03.076154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-222847a6-d950-48f2-a779-93637cd713a3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078308 Jun 22 19:49:03.076738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 671/1054] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:02 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:03.428982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:03.429985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:03.438188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:03.438718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:03.439604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:03.440205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:03.575973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:03.584050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-20c37077-2e98-4404-8be7-c24ecc170acd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161686 Jun 22 19:49:03.584652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 384/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:04.098760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:04.099859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:04.159176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:04.166578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:04.168063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:04.169204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e6274c05-2f45-4f1f-bb5b-1ed9038e4413 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077446 Jun 22 19:49:04.169766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 672/1056] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:04 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:04.605045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:04.606055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:04.617122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:04.617872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:04.619135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:04.619836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:04.763420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:04.771078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-38eba546-4d70-4d65-844b-ba26eef4174a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.172743 Jun 22 19:49:04.771652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 385/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:05.189464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:05.190168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:05.244312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:05.251745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:05.253304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:05.254403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-79004c82-dfe2-426a-9602-54d27b8a6a84 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070330 Jun 22 19:49:05.254950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 673/1058] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:05 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:05.791239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:05.791867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:05.801095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:05.801704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:05.802665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:05.803253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:05.933683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:05.941405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-db192f41-c3df-4fcb-9f65-daf467793806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156484 Jun 22 19:49:05.941948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 386/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:06.275404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:06.276042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:06.279469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:06.329270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:06.336857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:06.338365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:06.339463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9dcc9605-b531-4bb7-a6c4-2c8d607172e7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070105 Jun 22 19:49:06.339991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 674/1060] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:06 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:06.962234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:06.963172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:06.973665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:06.974335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:06.975507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:06.976171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:07.115695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:07.123669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72922ee0-1fdc-4e6a-a2cb-51b1311ae615 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167555 Jun 22 19:49:07.124263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 387/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:07.362917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:07.364022 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:07.429882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:07.437218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:07.438705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:07.439809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58b2212a-57f4-4395-acb5-fa47dba7718e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.084202 Jun 22 19:49:07.440465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 675/1062] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:07 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:08.141938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:08.142545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:08.149716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:08.150182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:08.150935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:08.151361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:08.288622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:08.296885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0dca3b6b-faeb-4b6b-b33f-15673f9c2659 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158868 Jun 22 19:49:08.297463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 388/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:08.469349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:08.469349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:08.521182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:08.528978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:08.530465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:08.531569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-06126e6c-b563-4cda-b7f1-b4b399e6453b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076319 Jun 22 19:49:08.532144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 676/1064] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:08 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:08.613417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:49:08.613700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:49:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:49:09.318581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:09.319564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:09.330615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:09.331361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:09.332728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:09.333445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:09.471216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:09.479583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a175ad28-181d-4d83-9d23-e799c482dd1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167518 Jun 22 19:49:09.480159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 389/1065] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:09.553774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:09.554855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:09.613609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:09.624091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:09.625616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:09.626745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dad7fb40-aacd-49de-bb30-1f2926dd6689 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079457 Jun 22 19:49:09.627301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 677/1066] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:09 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:10.324949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:49:10.325880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:49:10.499453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:10.500265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:10.503497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=52 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:10.509939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:10.510379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:10.511122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:10.511542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:10.514256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:10.644707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:10.645326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:10.655870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:10.663574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8418a742-05fc-460e-a2d8-7b25a8c55dc7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170222 Jun 22 19:49:10.664136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 390/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:10.696842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:10.704063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:10.705595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:10.706699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-60308ead-bc1d-467a-974d-4be81229e78e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065964 Jun 22 19:49:10.707252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 678/1068] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:10 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:11.681589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:11.682161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:11.689214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:11.689689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:11.690446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:11.690872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:11.725007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:11.725549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:11.782003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:11.789723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:11.791314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:11.792623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d42f410a-3d13-4269-8d85-1c97de2c5f79 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071922 Jun 22 19:49:11.793257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 679/1069] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:11 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:11.824817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:11.832785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4136170c-f628-411a-8591-1ca9642a96e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155236 Jun 22 19:49:11.833322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 391/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:12.814721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:12.815557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:12.850453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:12.851091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:12.858283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:12.858738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:12.859503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:12.859931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:12.872231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:12.879632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:12.881150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:12.882241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-abebfd71-2e0d-41f3-ac9e-9c2604d93273 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074323 Jun 22 19:49:12.882794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 680/1071] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:12 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:12.991339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:12.999281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a6536adc-ed46-4a17-aa03-2138928bbfbc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.153021 Jun 22 19:49:12.999849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 392/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:13.903663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:13.904684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:13.978325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:13.989931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:13.992359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:13.993860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-01918250-9e03-4a77-9d4a-bf18361caf98 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.096816 Jun 22 19:49:13.994446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 681/1073] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:13 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:14.016365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:14.017571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:14.024467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:14.024918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:14.025674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:14.026107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:14.172165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:14.184583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8fb8cbf8-6073-4d6d-a8f2-79f20408f52f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171723 Jun 22 19:49:14.185394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 393/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:49:15.016474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:15.017495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:15.079632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:15.091503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:15.094090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:15.095820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eeb758ba-7436-473f-8bdd-96647675c6f9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.085947 Jun 22 19:49:15.097063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 682/1075] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:15 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:15.209983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:15.210957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:15.222293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:15.223044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:15.224343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:15.225058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:15.386890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:15.399082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-780802db-ea39-4aab-8375-d6592d2a67fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.195234 Jun 22 19:49:15.399716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 394/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:16.117443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:16.118107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:16.173713 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:16.182587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:16.184140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:16.185344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a246ce52-738d-43b8-b0e0-d84a5604430b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072393 Jun 22 19:49:16.185927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 683/1077] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:16 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:16.420506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:16.421349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:16.432245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:16.433004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:16.434238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:16.434941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:16.580374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:16.589818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b11053c4-acbf-43cd-84aa-cc1b168fda7b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175977 Jun 22 19:49:16.590413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 395/1078] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:17.207298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:17.208270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:17.267526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:17.274809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:17.276414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:17.278099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0d179379-d3a1-4352-8631-e55f4cbf120e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076957 Jun 22 19:49:17.278818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 684/1079] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:17 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:17.611169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:17.612182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:17.621413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:17.621855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:17.622603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:17.623025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:17.761762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:17.773538 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c77f30ef-7a14-497f-813c-adad0a2b86fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168431 Jun 22 19:49:17.774488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 396/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:18.302300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:18.302902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:18.356071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:18.358295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=58 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:18.364586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:18.366074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:18.367165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2e39d853-6980-45a9-821a-e7f10ba35bdf tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071182 Jun 22 19:49:18.367715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 685/1081] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:18 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:18.795399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:18.796534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:18.807255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:18.807996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:18.809331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:18.810040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:18.966094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:18.978774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1dfce34d-1d52-42d0-84f0-703cc1f7b11c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.189685 Jun 22 19:49:18.979613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 397/1082] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:18 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:19.386196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:19.386821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:19.439209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:19.447061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:19.448612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:19.449727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d8fdca22-e66c-44ff-90bb-8dce548527c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068218 Jun 22 19:49:19.450276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 686/1083] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:19 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:20.000552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:20.001535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:20.012457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:20.013184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:20.014518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:20.015214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:20.170238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:20.178207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-46b37dd5-3793-478d-8787-3cd9e4c0b6b1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.184218 Jun 22 19:49:20.178774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 398/1084] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:20.471316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:20.472728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:20.538675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:20.546397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:20.547872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:20.549013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-668c0c1a-ec3b-4600-89c2-cad26348395d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.084178 Jun 22 19:49:20.549538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 687/1085] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:20 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:21.200384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:21.201468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:21.213476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:21.214391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:21.215850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:21.216693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:21.368059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:21.375977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-658a8ecf-2dbf-4338-beb0-43491a707a56 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.182917 Jun 22 19:49:21.376585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 399/1086] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:21.569206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:21.569775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:21.626332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:21.633890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:21.635448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:21.636571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f0bc6294-a263-4936-93fa-0a449e9d5d78 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071354 Jun 22 19:49:21.637106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 688/1087] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:21 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:22.397291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:22.398234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:22.409116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:22.409846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:22.411079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:22.411778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:22.548375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:22.560719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-102e9f89-3aaf-4c1d-8051-73f576f7b198 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169562 Jun 22 19:49:22.561457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 400/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:22.658528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:22.659462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:22.713373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:22.720887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:22.722687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:22.723778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fff34925-d9da-4310-941e-997c34c67a34 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071875 Jun 22 19:49:22.724350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 689/1089] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:22 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:23.585857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:23.586915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:23.595180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:23.595739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:23.597017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:23.597520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:23.741693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:23.743621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:23.744266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:23.750338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-958b71a8-c501-4b30-8b9e-4721cfc57537 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171556 Jun 22 19:49:23.750954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 401/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:23.798799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:23.808810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:23.810278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:23.811415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9c5220fd-da11-4e6e-882e-f33ab428a6d1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073016 Jun 22 19:49:23.811969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 690/1091] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:23 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:24.772429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:24.773316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:24.784327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:24.785074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:24.786358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:24.787047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:24.833165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:24.833806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:24.889926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:24.897566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:24.899057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:24.900170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b90a86d9-8799-4bf1-a1a3-30d36440207a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071018 Jun 22 19:49:24.900955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 691/1092] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:24 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:24.922950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:24.931494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7e6bd2c8-7d4b-4b74-b323-5a9dfc3f7291 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165585 Jun 22 19:49:24.932142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 402/1093] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:25.922452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:25.923318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:25.950347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:25.950925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:25.957725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:25.958177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:25.958949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:25.959381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:25.977887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:25.985163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:25.986664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:25.987758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ef09a242-c2ff-41cc-a304-5bfea27eac36 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.071953 Jun 22 19:49:25.988321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 692/1094] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:25 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:26.089536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:26.101651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f8eed308-7121-4125-b6b7-1961a21c6afd tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.154956 Jun 22 19:49:26.102508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 403/1095] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:27.009881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:27.010827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:27.075163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:27.082848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:27.084368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:27.085453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-45560fe8-2497-4a9a-ae6f-243c15268b93 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082240 Jun 22 19:49:27.085995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 693/1096] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:27 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:27.129533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:27.130925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:27.138797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:27.139244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:27.140000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:27.140428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:27.282484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:27.290151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8be86e70-ef1b-43e2-8b28-e24e75375e1d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167753 Jun 22 19:49:27.290755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 404/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:28.109999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:28.110968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:28.165499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:28.173259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:28.174758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:28.175871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-84d7146c-da38-4116-9b9d-ec5d2d7e0021 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072394 Jun 22 19:49:28.176433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 694/1098] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:28 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:28.317185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:28.318161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:28.329216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:28.329958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:28.331200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:28.331910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:28.472780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:28.480748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5a9e5331-f37e-4bb5-8be7-d9f58ce92fa5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170029 Jun 22 19:49:28.481321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 405/1099] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:29.198240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:29.199158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:29.265082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:29.272559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:29.274027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:29.275104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e9dc9ec7-01d1-4797-8cb1-3d523366cc20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.083527 Jun 22 19:49:29.275656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 695/1100] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:29 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:29.497964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:29.498579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:29.505639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:29.506090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:29.506861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:29.507288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:29.642234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:29.644560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:29.651688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4ffdacd3-f540-442f-985c-e9b4da3dc25f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157699 Jun 22 19:49:29.652305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 406/1101] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:30.300143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:30.301103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:30.356324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:30.363815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:30.365362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:30.366476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3bc329a9-230e-4851-9639-52037e42dd43 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072935 Jun 22 19:49:30.367034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 696/1102] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:30 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:30.673443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:30.674221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:30.685535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:30.686279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:30.687523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:30.688276 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:31.061617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:31.073506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bd1a5fd0-ebe1-46cc-aa79-cea4d7da0c0b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.406407 Jun 22 19:49:31.074396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 407/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:30 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:31.387227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:31.387896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:31.461305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:31.470469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:31.472303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:31.476021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ef451fb1-998b-4255-a485-606fffd88e03 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.094037 Jun 22 19:49:31.476986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 697/1104] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:31 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:32.099510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:32.100657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:32.111332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:32.112085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:32.113535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:32.114240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:32.250388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:32.257968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90bde1e2-97f7-4ba0-b539-5d5641dd9533 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165182 Jun 22 19:49:32.258609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 408/1105] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:32.493846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:32.494461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:32.548676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:32.556294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:32.557783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:32.558915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3d44fb9f-ca19-4346-921c-f62cc8064ff4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069131 Jun 22 19:49:32.559462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 698/1106] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:32 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:33.278358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:33.279227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:33.288095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:33.288734 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:33.289741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:33.290312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:33.427338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:33.435570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90042c26-fbe3-4199-aaaf-9f5d4885c589 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162857 Jun 22 19:49:33.436145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 409/1107] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:33.581136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:33.582114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:33.587147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:33.644703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:33.652463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:33.653956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:33.655211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b7aece12-32e7-4eeb-9f3b-17401f4338a2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.080492 Jun 22 19:49:33.656027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 699/1108] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:33 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:34.456617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:34.457597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:34.469859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:34.470661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:34.472560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:34.473503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:34.609237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:34.621040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94e8f9d5-835c-4e39-8878-4d1e84e4aaf8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170525 Jun 22 19:49:34.621799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 410/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:34.677353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:34.678352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:34.738619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:34.747809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:34.749364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:34.750478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1cf71b1e-37c5-4553-bafd-b50b63d1d645 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079890 Jun 22 19:49:34.751065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 700/1110] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:34 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:35.646713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:35.647584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:35.655385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:35.655826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:35.656624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:35.657048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:35.774019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:35.774719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:35.789941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:35.797733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ec9c2cb-7122-4893-8217-d6c26e8bd408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157633 Jun 22 19:49:35.798294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 411/1111] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:35 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:35.827416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:35.835081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:35.836648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:35.837835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b57bfe0b-6c64-432f-bc39-6b288cffa68d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067749 Jun 22 19:49:35.838401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 701/1112] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:35 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:36.819050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:36.819912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:36.828052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:36.828536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:36.829287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:36.829715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:36.860459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:36.861165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:36.916474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:36.923780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:36.925309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:36.926413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1dd7a9a-1da5-4c59-8add-094a7b687d20 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069950 Jun 22 19:49:36.927279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 702/1113] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:36.964577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:36.972859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b5857f28-c4a1-4183-a0ab-ff3f03e243a7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160562 Jun 22 19:49:36.973468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 412/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:37.944492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:37.945083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:37.990318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:37.990878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:37.997971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:37.999073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:37.999928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:38.000406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:38.001217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:38.008709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:38.010213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:38.011315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-247c8ab3-953d-4f02-8c46-b099047819bc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070812 Jun 22 19:49:38.011863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 703/1115] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:38.139548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:38.147281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-48181e5c-c850-4a44-b53f-6ef34345e3f0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160868 Jun 22 19:49:38.147855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 413/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:39.033674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:39.034686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:39.089101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:39.096674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:39.098177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:39.099275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e0395fae-6e47-4eea-86bc-a6c7876e52f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072320 Jun 22 19:49:39.099826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 704/1117] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:39 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:39.166569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:39.167394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:39.176491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:39.177108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:39.178138 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:39.178749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:39.331191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:39.339514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c51c4c29-d447-4297-904e-51bbfa13f991 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.178334 Jun 22 19:49:39.340088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 414/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:40.121780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:40.122786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:40.185938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:40.193705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:40.195197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:40.196338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e639aa35-0d0a-4f88-846d-37ebd4ebbf12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.081338 Jun 22 19:49:40.196890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 705/1119] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:40 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:40.361925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:40.362524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:40.369221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:40.369673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:40.370427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:40.370863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:40.507663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:40.516046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e7f784c8-355a-4252-b21e-4ea3acaf25c0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158151 Jun 22 19:49:40.516663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 415/1120] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:41.218169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:41.219125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:41.274444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:41.282062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:41.283555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:41.284695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e33a25e0-b560-420f-8e29-c46511a8541d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073030 Jun 22 19:49:41.285248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 706/1121] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:41.539264 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:41.540291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:41.543885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=52 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:41.552996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:41.553724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:41.554974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:41.555695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:41.690442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:41.698513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-188236c2-ef1c-4a39-9076-9775e86f39f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167203 Jun 22 19:49:41.699192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 416/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:41 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:42.307020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:42.307629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:42.367703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:42.375168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:42.376704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:42.377804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3da73cd5-8746-431b-828c-77136871f9f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077333 Jun 22 19:49:42.378354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 707/1123] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:42 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:42.719533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:42.720583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:42.730517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:42.730985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:42.731740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:42.732208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:42.866234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:42.874080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a74fc872-569e-402e-85af-a5ac8c126b9d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161060 Jun 22 19:49:42.874644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 417/1124] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:43.399996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:43.401000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:43.465089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:43.473240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:43.474728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:43.475844 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c82e96eb-c00b-4deb-bf13-e10c55ee5ed5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082438 Jun 22 19:49:43.476412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 708/1125] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:43.894911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:43.895954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:43.904472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:43.904915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:43.905671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:43.906099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:44.202378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:44.214516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2a08ec0f-ade2-4d9a-82fc-2005a4db47d8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.325828 Jun 22 19:49:44.215236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 418/1126] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:44.496882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:44.497609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:44.550625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:44.558207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:44.559737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:44.560887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7ca37dc5-c2ae-423f-968f-d321321d8613 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069292 Jun 22 19:49:44.561437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 709/1127] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:44 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:45.241105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:45.242091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:45.250075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:45.250565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:45.251395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:45.251866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:45.390227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:45.397898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d9108f0f-a574-4181-ae68-1ffa29b427a3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163254 Jun 22 19:49:45.398447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 419/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:45.582908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:45.583842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:45.650465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:45.662451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:45.665002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:45.666482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0cf4452f-438c-48ec-b21d-e7edb7b16f66 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.090248 Jun 22 19:49:45.667042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 710/1129] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:46.424690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:46.425656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:46.436787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:46.437524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:46.438769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:46.439479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:46.577622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:46.589064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-621a94f8-d782-4111-b43c-2ebdfde39f91 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170719 Jun 22 19:49:46.589846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 420/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:46.693299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:46.694293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:46.759699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:46.766859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:46.768375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:46.769479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6ed1d3c2-a950-4a15-ae74-860bb7e2f314 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.086923 Jun 22 19:49:46.770034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 711/1131] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:47.610460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:47.611478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:47.621309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:47.621762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:47.622522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:47.622950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:47.758348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:47.769846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1f6373b0-536f-4e1f-9766-bc025f06112f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165613 Jun 22 19:49:47.770596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 421/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:47.786813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:47.787435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:47.841501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:47.853325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:47.854942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:47.856048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b35f375a-4b1c-4e27-827a-8f833c23284b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073209 Jun 22 19:49:47.856707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 712/1133] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:47 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:48.789259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:48.789866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:48.796830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:48.797265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:48.798056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:48.798582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:48.874322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:48.874923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:48.927644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:48.935387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:48.936905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:48.937990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-41af0fc2-b333-46f4-a2bc-662719a7fa6c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067666 Jun 22 19:49:48.938506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 713/1134] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:48 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:49.007958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:49.015969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e3dbee3-ab91-4b49-aea7-7fb6939d212b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.230711 Jun 22 19:49:49.016549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 422/1135] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:49.959729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:49.960743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:50.015857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:50.018048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=58 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:50.024150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:50.025772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:50.026865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8608f66b-3095-48b1-88b3-cf54a7870fa5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073661 Jun 22 19:49:50.027377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 714/1136] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:50.033312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:50.033923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:50.042497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:50.043120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:50.044226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:50.044842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:50.063181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:49:50.191568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:50.201076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b8d7fa4d-2432-4771-985f-6f93ac53e9b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171299 Jun 22 19:49:50.201841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 423/1137] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:51.048912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:51.049847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:51.113284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:51.120817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:51.122353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:51.123458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c963a301-b79d-4fda-8f0f-f9af1bb3fe15 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.081582 Jun 22 19:49:51.124018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 715/1138] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:51 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:51.223999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:51.224628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:51.231454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:51.231904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:51.232691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:51.233121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:51.363347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:51.371158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e19b6ff-cec6-499f-8cf1-e6184f757902 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.151509 Jun 22 19:49:51.371694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 424/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:52.142354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:52.142987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:52.198535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:52.206069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:52.207539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:52.208678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b7ffc8ba-5abf-451d-8336-5b5cdd84621d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070710 Jun 22 19:49:52.209231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 716/1140] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:52 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:52.397551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:52.398390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:52.409199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:52.409942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:52.411192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:52.411905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:52.546016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:52.554187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ff9d0319-d686-426a-8935-80e6f72fb1fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163419 Jun 22 19:49:52.554770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 425/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:53.230788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:53.231510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:53.291438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:53.299588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:53.301390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:53.302652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa2f4813-264c-45ff-91a6-eee0af7c120d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077862 Jun 22 19:49:53.303210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 717/1142] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:53 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:53.580671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:53.581669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:53.590893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:53.591344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:53.592126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:53.592573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:53.729978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:53.738213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a64b24e5-0dea-4fa5-96e9-e058eae57151 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163998 Jun 22 19:49:53.738713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 426/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:54.324710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:54.325647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:54.382729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:54.390261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:54.391749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:54.392880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b831f089-a708-42ef-afba-f64b17fb98d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074738 Jun 22 19:49:54.393405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 718/1144] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:54 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:54.759478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:54.760454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:54.768440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:54.768975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:54.769868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:54.770373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:54.909632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:54.919929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-38df7fe9-ad87-4e17-a959-e5560f095033 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167006 Jun 22 19:49:54.920488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 427/1145] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:54 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:55.415148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:55.416309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:55.479770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:55.489549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:55.491037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:55.492145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-03f2e30e-2d71-4ba4-bdfb-adf2bfc0d430 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.083554 Jun 22 19:49:55.492734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 719/1146] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:55 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:55.940457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:55.941493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:55.952704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:55.953449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:55.954710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:55.955433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:56.097143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:56.107600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6a2aeb72-35c2-4ca6-b895-79656c222ee6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.173651 Jun 22 19:49:56.108200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 428/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:56.517662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:56.518346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:56.571630 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:56.579229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:56.580762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:56.581857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f820831a-56a7-4cf4-b88c-fe782df356c3 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069781 Jun 22 19:49:56.582408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 720/1148] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:56 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:57.128682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:57.129682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:57.138364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:57.138811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:57.139567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:57.139998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:57.274523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:57.282234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d7396101-d530-427c-9e51-7262cabe8fbb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160102 Jun 22 19:49:57.282791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 429/1149] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:57.603964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:57.604595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:57.657735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:57.665595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:57.667190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:57.668326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b7694437-e886-4193-acc6-a3ed7113c85d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070520 Jun 22 19:49:57.668877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 721/1150] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:57 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:58.306502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:58.307117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:58.314005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:58.314445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:58.315257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:58.315683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:58.452261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:58.460025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f1680911-405e-46b9-a684-d2cb50768dd4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159755 Jun 22 19:49:58.460711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 430/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:58.690604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:58.691509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:58.747996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:58.755660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:58.757186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:58.758289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b54233a6-0199-4222-b527-308f5a7518ee tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074421 Jun 22 19:49:58.758846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 722/1152] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:58 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:49:59.481954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:59.483140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:59.494247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:59.494703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:59.495476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:49:59.495909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:49:59.639010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:59.646798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4f793073-dc80-437f-b308-3d7f87e5a66f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.171595 Jun 22 19:49:59.647359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 431/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:49:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:49:59.778484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:49:59.779194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:49:59.839654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:59.850500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:59.852779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:49:59.854179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-95cb5fc5-dc2e-423a-8b02-9675a1906ad6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.081096 Jun 22 19:49:59.854729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 723/1154] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:49:59 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:00.668823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:00.669699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:00.680710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:00.681492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:00.682751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:00.683471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:00.823481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:00.831681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8f8ad47a-28ee-4bda-aeab-f8441c3a7bb6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169802 Jun 22 19:50:00.832281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 432/1155] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:00.872510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:00.873089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:00.876529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:00.936618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:00.944191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:00.945628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:00.946727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d4de3b32-b8d1-4959-8aa4-1d0444253622 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078215 Jun 22 19:50:00.947402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 724/1156] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:00 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:01.853762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:01.854664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:01.865723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:01.866465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:01.867770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:01.868537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:01.965064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:01.965652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:02.003913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:02.011598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8872f9bd-7479-45c0-b2d4-aed44d6ccc9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165281 Jun 22 19:50:02.012393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 433/1157] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:02.019709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:02.027098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:02.028623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:02.029768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6ba1af03-5ae8-46ce-95fe-f1aac1480df0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068766 Jun 22 19:50:02.030296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 725/1158] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:01 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:03.033418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:03.034322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:03.043713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:03.044154 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:03.044936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:03.045359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:03.047752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:03.048425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:03.101209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:03.108916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:03.110458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:03.111575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-66622fd9-920e-456b-8f8e-6a5a9d852c48 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067820 Jun 22 19:50:03.112118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 726/1159] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:03 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:03.175840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:03.187389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e5771361-ea10-4fe6-8ab1-d45d9934dfa4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160372 Jun 22 19:50:03.188206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 434/1160] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:04.134238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:04.135289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:04.195281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:04.202934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:04.204513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:04.205624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1780e888-e597-427d-b76e-9f6614f52419 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078304 Jun 22 19:50:04.206174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 727/1161] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:04 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:04.208267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:04.208877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:04.215850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:04.216319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:04.217121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:04.217557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:04.352710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:04.361090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4f30e34e-c371-428d-856a-1049378d47a4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156818 Jun 22 19:50:04.361636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 435/1162] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:05.228559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:05.229236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:05.285077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:05.293880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:05.295362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:05.296520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6057c086-0810-4b84-9685-dad653592b06 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.074459 Jun 22 19:50:05.297078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 728/1163] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:05 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:05.378688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:05.379249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:05.386557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:05.387008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:05.387870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:05.388351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:05.537328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:05.545288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-156399f0-20a4-49cc-9408-317a90c8e671 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170538 Jun 22 19:50:05.545853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 436/1164] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:06.318522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:06.319371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:06.381870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:06.389217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:06.390695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:06.391785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-edf03417-448a-41c0-9855-7133d2da8400 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079960 Jun 22 19:50:06.392375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 729/1165] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:06 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:06.565256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:06.566227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:06.575573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:06.575956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:06.576754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:06.577185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:06.742166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:06.750254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-683cd38d-76ca-4ff4-9442-2e2a1d599b6c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.191486 Jun 22 19:50:06.750811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 437/1166] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:07.413761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:07.414724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:07.471485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:07.481117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:07.482613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:07.483725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-05fe7664-a902-46ac-a4a1-3ddb5b64c8b7 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076504 Jun 22 19:50:07.484311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 730/1167] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:07 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:07.770835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:07.771832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:07.780469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:07.780940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:07.781740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:07.782198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:07.918400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:07.926533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-89637143-0f56-4bbb-9662-6618f6d6c185 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162236 Jun 22 19:50:07.927073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 438/1168] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:08.504218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:08.504871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:08.568904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:08.580828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:08.582911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:08.584755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d6ac6e96-7cb2-48cc-9bc0-6c1dfcab536f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.086157 Jun 22 19:50:08.585642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 731/1169] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:08 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:08.949379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:08.950339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:08.961474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:08.962211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:08.963459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:08.964168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:09.110573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:09.118205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8efcfa69-5777-4568-9a86-ae024372bc71 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175698 Jun 22 19:50:09.118770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 439/1170] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:09.607355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:09.608315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:09.676139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:09.683670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:09.685187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:09.686301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fb331576-b99a-4b84-b441-8474ffc53825 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.085613 Jun 22 19:50:09.686855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 732/1171] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:09 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:10.138867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:10.139803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:10.150548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:10.150992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:10.151753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:10.152206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:10.154759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:10.299773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:10.307690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8738f1a6-19c3-4901-9452-b85562f9d02d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.175262 Jun 22 19:50:10.308310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 440/1172] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:10.707881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:10.708825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:10.768299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:10.775622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:10.777146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:10.778238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2593f648-6c64-4c56-bdaa-76b6e379a375 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076841 Jun 22 19:50:10.778794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 733/1173] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:10 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:11.329206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:11.330171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:11.341145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:11.341881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:11.343130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:11.343826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:11.492208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:11.500460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c6b9da3a-da93-493b-8e0c-f830767df8c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177833 Jun 22 19:50:11.501029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 441/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:11.800162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:11.801208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:11.864129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:11.872739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:11.874674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:11.876438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-31d94d05-6d10-43c3-87fe-3a8b4d29aa5e tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.082567 Jun 22 19:50:11.877109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 734/1175] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:11 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:12.517790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:12.518431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:12.520783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=52 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:12.527065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:12.527542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:12.528337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:12.528774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:12.661157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:12.670228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:12.670724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:12.677853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-74681f6d-8dd9-4c4f-b1ed-983cab9c2220 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163835 Jun 22 19:50:12.678450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 442/1176] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:12.687555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:12.688044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:12.688871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:12.689306 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:12.898565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:12.899568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:12.957347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:12.965059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:12.966553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:12.967641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-beea95a3-a42b-4a55-bd5b-1bc6537967c1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075563 Jun 22 19:50:12.968239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 443/1177] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:12 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:13.349504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:50:13.698662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:13.699672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:13.711638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.712555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:13.713326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.713755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:13.849308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:13.857283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-167b0256-3f0b-4cfa-8305-2a2dd4bae1f4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165278 Jun 22 19:50:13.857847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 444/1178] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:13.862168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:13.862651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:13.868593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.869037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:13.869793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.870224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:13.896636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:50:13.975750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-980cf9c5-fb31-470f-9085-4ee5f494b798 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 204 len: 0 microversion: 2.1 time: 0.116638 Jun 22 19:50:13.976704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 445/1179] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:50:13 2022] DELETE /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:50:13.981970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:13.982710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:13.988930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.989376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:13.990131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:13.990558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.015437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:50:14.092632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-18875532-1ceb-48eb-b280-08ae94f43f2b tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 204 len: 0 microversion: 2.1 time: 0.114009 Jun 22 19:50:14.093311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 446/1180] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:50:13 2022] DELETE /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:50:14.099885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:14.100908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:14.107521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.107972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.108765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.109197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.248092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:14.259535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dafa7e14-59d6-45d1-b1fc-397777b7b895 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1688 microversion: 2.1 time: 0.164891 Jun 22 19:50:14.260092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 447/1181] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:14 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:14.264456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:14.265045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:14.316349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:14.323790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:14.325336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:14.326436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9e19aa4e-207b-4ee3-98fd-2e62b9417546 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065422 Jun 22 19:50:14.327027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 448/1182] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:14.331512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:14.332130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:14.338344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.338788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.339577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.340006 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.476619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:14.487973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-422cc6d7-fa70-4460-b9e0-10acc90f7f12 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1680 microversion: 2.1 time: 0.159638 Jun 22 19:50:14.488723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 449/1183] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:14 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:14.877844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:14.878586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:14.887406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.887860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:14.888662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:14.889099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:15.032286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:15.040456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-62a8412f-0350-4e1f-986c-15535939b64f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168863 Jun 22 19:50:15.041028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 450/1184] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:15.277105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:15.277699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:15.284026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:15.284505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:15.285259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:15.285685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:15.677298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:15.685272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e0af1f0-06b0-4ac2-b10c-620e1cf89d2b tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1688 microversion: 2.1 time: 0.412102 Jun 22 19:50:15.685849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 451/1185] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:15 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1688 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:15.690487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:15.690926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:15.797636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:15.805344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:15.807818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:15.808972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-985404a1-ac0c-4608-8d38-9c26355122d8 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.122210 Jun 22 19:50:15.809525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 452/1186] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:15 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:15.813936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:15.814522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:15.820854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:15.821319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:15.822156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:15.822583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:16.357583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.365308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3174963c-6742-4718-824a-e60ecbf405ad tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1680 microversion: 2.1 time: 0.554836 Jun 22 19:50:16.365884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 453/1187] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:15 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:16.370334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:16.370906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:16.376933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:16.377384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:16.378146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:16.378575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:16.684838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.692535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ab9020b6-860a-420a-ad16-6a21f027f4ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.325625 Jun 22 19:50:16.693111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 454/1188] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:16.702964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:16.703116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:16.709444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:16.709884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:16.710944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:16.711369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:16.799241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.807608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d41532dd-66e1-4ad1-a064-f3e6ae7de644 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1622 microversion: 2.1 time: 0.109079 Jun 22 19:50:16.808413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 455/1189] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:16 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1622 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:50:16.826819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:16.827428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:16.919869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.927792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.928926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:16.930038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94c12c9d-2793-4286-8d65-58e72be1a55c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.107126 Jun 22 19:50:16.930799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 456/1190] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:16 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:17.249127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-c1a18cc4-edfb-436a-877d-0201c3dee643 req-5f02c848-c4bb-4a26-8c52-3875d053a67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8bd17a-b43a-4aec-a93f-fb76b65d336e", "name": "network-vif-deleted", "tag": "fcd45028-e93b-4996-869d-fb1526d6edb8"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:17.260079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c1a18cc4-edfb-436a-877d-0201c3dee643 req-5f02c848-c4bb-4a26-8c52-3875d053a67a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.260877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c1a18cc4-edfb-436a-877d-0201c3dee643 req-5f02c848-c4bb-4a26-8c52-3875d053a67a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.273657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-c1a18cc4-edfb-436a-877d-0201c3dee643 req-5f02c848-c4bb-4a26-8c52-3875d053a67a service nova] Creating event network-vif-deleted:fcd45028-e93b-4996-869d-fb1526d6edb8 for instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e on hv-cinder-84721 Jun 22 19:50:17.280420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-c1a18cc4-edfb-436a-877d-0201c3dee643 req-5f02c848-c4bb-4a26-8c52-3875d053a67a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148496 Jun 22 19:50:17.281654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 457/1191] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:50:17.384633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:17.386178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:17.393448 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.393907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.395329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.395672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.400351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:17.435736 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.436687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.436807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lazy-loading 'fault' on Instance uuid e60784b8-22f8-4043-9656-c629245206da {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:50:17.497464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:17.513369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-685c1737-432a-4749-bac6-8969fb99233c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 200 len: 1421 microversion: 2.1 time: 0.134070 Jun 22 19:50:17.519772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 458/1192] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:17 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 1421 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:17.717423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:17.718447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:17.726424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.727082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.727914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.728383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.898114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:17.912157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-96299b89-d808-43c2-bfd6-233a474c78d6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.205638 Jun 22 19:50:17.912933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 459/1193] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:50:17.928833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:17.941972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:17.962566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.966150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:17.967383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:17.967840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:18.038080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:18.038317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:18.039013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lazy-loading 'fault' on Instance uuid cc8bd17a-b43a-4aec-a93f-fb76b65d336e {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:50:18.093284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:18.101232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-237583ce-0aea-403d-891e-2d27da2e65fa tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 200 len: 1335 microversion: 2.1 time: 0.175771 Jun 22 19:50:18.102157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 460/1194] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:17 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 1335 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:18.107676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:18.107676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:18.179613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:18.188576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:18.190068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:18.191178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8e98988f-b37e-4cfa-8513-4d6b1dfd0525 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.088000 Jun 22 19:50:18.191926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 461/1195] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:18 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:18.530882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:18.531468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:18.537796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:18.538239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:18.539003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:18.539433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:18.561243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da HTTP/1.1 Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:50:18.563244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 19:50:18.565022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'e60784b8-22f8-4043-9656-c629245206da'} Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:50:18.566073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 19:50:18.568019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:18.570385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:50:18.570385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85432b22-0f99-4228-ad0e-4988c1d92ec6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 404 len: 111 microversion: 2.1 time: 0.041479 Jun 22 19:50:18.574356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 462/1196] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:18 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 19:50:18.579663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e4ff4c7-b57e-4994-946d-a41320e42e02 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '.version_select at 0x7fdc19b7a8b0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:18.583184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e4ff4c7-b57e-4994-946d-a41320e42e02 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [cd346772-0368-4ab5-8b4c-15c6a149b38a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 19:50:19.594930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e4ff4c7-b57e-4994-946d-a41320e42e02 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [cd346772-0368-4ab5-8b4c-15c6a149b38a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57658. Jun 22 19:50:19.621772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e4ff4c7-b57e-4994-946d-a41320e42e02 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394153160" status: 202 len: 0 microversion: 2.1 time: 1.046273 Jun 22 19:50:19.622614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 463/1197] 10.222.0.26 () {58 vars in 1220 bytes} [Wed Jun 22 19:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394153160 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:50:19.630079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:19.630730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:19.637245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:19.637697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:19.638467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:19.639039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:19.820577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:19.829903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37a8895b-f97c-4df9-b65c-881aae886c2c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.206181 Jun 22 19:50:19.830543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 464/1198] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:19.845197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:19.847065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: cc8bd17a-b43a-4aec-a93f-fb76b65d336e] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:19.855856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:19.856376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:19.857261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:19.857733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:19.873646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] HTTP exception thrown: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Request method failure captured: Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e HTTP/1.1 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_Lr8z5JzgjQL9TYHcBPh0MLSB6eIRV-fljd_yD9TeLhhluFJLoUPohhGotgWlb3mXMAGp00Zc_NU44Rhb59-Zhd8UQ6_rgrPjbJhWSNfrPUHEnqvnjRvRNGGcRA5RIoY7P_Cd4aR29ttKB9KtyYXEMtwRE9lcCK-XyS-e-MjjUr0c Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:50:19.875258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8afcbe68ae6d4faea1026898d97882c8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: fe09f44c5fac46799e0d6883004151bf Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. Jun 22 19:50:19.876778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'cc8bd17a-b43a-4aec-a93f-fb76b65d336e'} Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:50:19.877663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. Jun 22 19:50:19.879075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:50:19.881570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Returning 404 to user: Instance cc8bd17a-b43a-4aec-a93f-fb76b65d336e could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:50:19.884130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c5adb1d1-f80e-4700-84b9-0d3818525bf6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e" status: 404 len: 111 microversion: 2.1 time: 0.042940 Jun 22 19:50:19.884717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 465/1199] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:19 2022] GET /compute/v2.1/servers/cc8bd17a-b43a-4aec-a93f-fb76b65d336e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:50:19.889729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:19.890354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:19.951116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:19.958718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:19.960263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:19.961398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3b045a14-1f04-4797-9776-985fcb122d7b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075505 Jun 22 19:50:19.961952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 466/1200] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:19 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:19.976398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-0968e31d-10d7-4e81-8cdc-348f57213d70 req-fcb7a28d-e084-457f-9212-d3652681f00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60784b8-22f8-4043-9656-c629245206da", "name": "network-vif-deleted", "tag": "c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:19.985380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-0968e31d-10d7-4e81-8cdc-348f57213d70 req-fcb7a28d-e084-457f-9212-d3652681f00b service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:19.985851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-0968e31d-10d7-4e81-8cdc-348f57213d70 req-fcb7a28d-e084-457f-9212-d3652681f00b service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:19.996589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-0968e31d-10d7-4e81-8cdc-348f57213d70 req-fcb7a28d-e084-457f-9212-d3652681f00b service nova] Creating event network-vif-deleted:c6953f13-0dde-4b1f-b9aa-1aa6aa774e0f for instance e60784b8-22f8-4043-9656-c629245206da on hv-cinder-84721 Jun 22 19:50:20.001689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-0968e31d-10d7-4e81-8cdc-348f57213d70 req-fcb7a28d-e084-457f-9212-d3652681f00b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028626 Jun 22 19:50:20.002287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 467/1201] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:50:20.007677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b1887fb8-a332-4699-97df-52503b217a17 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '.version_select at 0x7fdc19c4f8b0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:20.026438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b1887fb8-a332-4699-97df-52503b217a17 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320437276" status: 202 len: 0 microversion: 2.1 time: 0.022959 Jun 22 19:50:20.027094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 468/1202] 10.222.0.26 () {58 vars in 1220 bytes} [Wed Jun 22 19:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320437276 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:50:20.542540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6f4980c7-1c62-4c2e-8475-eb2076065de3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: .version_select at 0x7fdc19b7a8b0>, body: {"keypair": {"name": "tempest-keypair-2072458257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhjF8vwEHIa3umd/xXyVWh8+nqb2JrAVXzamTqSrjkgzclejsDdMMkBNqM/Y4+3X/M2OrFIotedmtVfxFujoRsPlxbt9Hx4G09de9yw1VTsMNqiQfV5bBb/MdLcIAh3KA=="}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:20.557681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-6f4980c7-1c62-4c2e-8475-eb2076065de3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:50:20.561963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-6f4980c7-1c62-4c2e-8475-eb2076065de3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:50:20.586675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6f4980c7-1c62-4c2e-8475-eb2076065de3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048061 Jun 22 19:50:20.587379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 469/1203] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:50:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:50:20.847925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:20.849046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:20.856136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:20.856603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:20.857372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:20.857800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:20.991722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:20.999606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3ca78779-ed4e-4587-bd6b-6c91f99185ee tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156097 Jun 22 19:50:21.000294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 470/1204] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:50:21.012625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:21.013422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:21.015455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:21.069790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:21.076891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:21.078367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:21.079450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0bb96302-0517-4fbf-abb5-933fbeadc3db tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078008 Jun 22 19:50:21.080034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 471/1205] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:21 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:21.868403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=41 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:21.916084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1550606557", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed32d9a9-ebb9-465d-887b-d293660c0101"}], "security_groups": [{"name": "tempest-securitygroup--1777125556"}], "key_name": "tempest-keypair-2072458257", "user_data": "}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:22.027806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] validate_networks() for [('ed32d9a9-ebb9-465d-887b-d293660c0101', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:50:22.674297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=44 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:22.702393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:50:22.702816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:50:22.703282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:50:22.703684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:50:22.704087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:50:22.713823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:22.714274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:22.715067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:22.715496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:22.732365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:50:22.736497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:50:22.747838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:50:22.750110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:50:22.801465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e7e36074-c77e-447e-b152-241a8293b807 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.889687 Jun 22 19:50:22.802783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 472/1206] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:50:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 19:50:22.808303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:22.809028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:22.816773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:22.817687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:22.819467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:22.819908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:22.964739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:22.973153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a52cb7b0-ebfc-4131-a423-fdb0156d4bfa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.169299 Jun 22 19:50:22.973821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 473/1207] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:22.987266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:22.987802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:23.043986 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:23.051531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:23.053121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:23.054305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7486aa0d-d1a0-476a-89ae-b79ff21d4589 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070793 Jun 22 19:50:23.054932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 474/1208] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:22 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:23.059539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-221cb238-c221-44f9-91d8-1a743940126a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:23.060125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-221cb238-c221-44f9-91d8-1a743940126a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:23.114968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-221cb238-c221-44f9-91d8-1a743940126a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:23.122795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-221cb238-c221-44f9-91d8-1a743940126a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1242 microversion: 2.1 time: 0.066905 Jun 22 19:50:23.123417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 475/1209] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:23 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:23.353865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=8 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:23.989469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:23.990220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:23.997038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:23.997491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:23.998262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:23.998697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:24.128847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:24.137035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3e9213d8-5fdc-42bd-b0a8-897233a81c29 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.151425 Jun 22 19:50:24.137620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 476/1210] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:24.142067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:24.142788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:24.229955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:24.237326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:24.238796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:24.239883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1210111d-a896-485f-8f9e-91418c4c99ae tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.101405 Jun 22 19:50:24.240468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 477/1211] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:24 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:24.250285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:24.250285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:24.254888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:24.255332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:24.256089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:24.256546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:24.357269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:24.365238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e6529af-4d90-4bfb-9804-808356bd9707 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1300 microversion: 2.1 time: 0.123599 Jun 22 19:50:24.365781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 478/1212] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:24 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:25.154427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:25.155974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:25.169665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:25.170238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:25.171027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:25.171438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:25.368495 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:25.378090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ae4d305-ef2a-4b97-a3ea-e156b1496bc4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.227816 Jun 22 19:50:25.378859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 479/1213] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:25.383245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:25.383918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:25.461939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:25.476161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:25.477860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:25.479153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e7f25d9-9012-4375-bc94-efbf085b822c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.099506 Jun 22 19:50:25.481092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 480/1214] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:25 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:25.486550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:25.487743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:25.496134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:25.496533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:25.497368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:25.498086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:25.734638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:25.743996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-50c20af1-1be7-46e1-a93e-3ba9f4d564d3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.263145 Jun 22 19:50:25.753101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 481/1215] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:25 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:25.753101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-1d39b625-7539-49bb-8224-4ab82029072f req-2e627228-77a5-4bd3-82d5-4448cb50a062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b876bf3-5d64-46b3-a37f-8a408ad328dd", "tag": "942f8a2a-3638-4bf8-8e3a-abf5a794011d"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:25.757547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1d39b625-7539-49bb-8224-4ab82029072f req-2e627228-77a5-4bd3-82d5-4448cb50a062 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:25.757993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1d39b625-7539-49bb-8224-4ab82029072f req-2e627228-77a5-4bd3-82d5-4448cb50a062 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:25.769095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-1d39b625-7539-49bb-8224-4ab82029072f req-2e627228-77a5-4bd3-82d5-4448cb50a062 service nova] Creating event network-changed:942f8a2a-3638-4bf8-8e3a-abf5a794011d for instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd on hv-cinder-84721 Jun 22 19:50:25.774106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-1d39b625-7539-49bb-8224-4ab82029072f req-2e627228-77a5-4bd3-82d5-4448cb50a062 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028487 Jun 22 19:50:25.774872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 482/1216] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:50:26.400732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:26.401821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:26.412798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:26.413542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:26.414784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:26.415489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:26.551187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:26.559080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cdcd1629-f0b4-4790-83a7-49f0fc3c92fa tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165832 Jun 22 19:50:26.559646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 483/1217] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:26.564143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:26.564766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:26.614733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:26.621987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:26.623474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:26.624597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-62375084-ba56-472e-9bf2-3a5d6944b7ac tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063942 Jun 22 19:50:26.625152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 484/1218] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:26 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:26.763599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:26.764693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:26.774738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:26.775187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:26.775944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:26.776407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:26.913278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:26.921653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bc21b4a7-459f-4a81-97ae-b6c37cbdd3c6 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.164566 Jun 22 19:50:26.922226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 485/1219] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:26 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:27.576596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:27.577281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:27.583672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:27.584148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:27.584900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:27.585329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:27.714693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:27.722782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a5487144-99af-4dba-9234-00843fa5421e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.150208 Jun 22 19:50:27.723346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 486/1220] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:27.727801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:27.728439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:27.778152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:27.786429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:27.787922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:27.789064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-18d85a48-0244-45dc-a8bb-8406199a248a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064830 Jun 22 19:50:27.789636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 487/1221] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:27 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:27.938823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:27.939435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:27.949296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:27.949754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:27.950524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:27.950962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:28.087553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:28.094983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-071a5f8f-d76e-4a6d-9ef0-7b4454b44e45 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.160167 Jun 22 19:50:28.095542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 488/1222] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:27 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:28.743455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:28.744186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:28.751330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:28.751827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:28.752763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:28.753245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:28.770340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:28.891754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:28.902632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8dc1d604-d582-4e20-8552-02d1facfc4c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165215 Jun 22 19:50:28.903414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 489/1223] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:28.908150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:28.908757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:28.966752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:28.978061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:28.980049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:28.981680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-62a71a24-6a11-4b8b-995b-da585753d057 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.077115 Jun 22 19:50:28.982413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 490/1224] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:28 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:29.116126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:29.117163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:29.128816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:29.129570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:29.130835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:29.131565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:29.283630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:29.291413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4a1d5fc8-4e61-4cb6-8478-457b430bdb9e tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.181683 Jun 22 19:50:29.292010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 491/1225] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:29 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:29.920659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:29.921625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:29.928954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:29.929417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:29.930200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:29.930622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:30.064244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:30.072569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-361a3ea5-466e-41ba-9114-76ac0c2dd51e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.156012 Jun 22 19:50:30.073135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 492/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:30.077464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-ba93f87a-9649-4c21-b541-b897ddaeca5d req-5e34a820-827e-4290-bfe5-05320774c479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b876bf3-5d64-46b3-a37f-8a408ad328dd", "name": "network-vif-plugged", "status": "completed", "tag": "942f8a2a-3638-4bf8-8e3a-abf5a794011d"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:30.085278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ba93f87a-9649-4c21-b541-b897ddaeca5d req-5e34a820-827e-4290-bfe5-05320774c479 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:30.085720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ba93f87a-9649-4c21-b541-b897ddaeca5d req-5e34a820-827e-4290-bfe5-05320774c479 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:30.097179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-ba93f87a-9649-4c21-b541-b897ddaeca5d req-5e34a820-827e-4290-bfe5-05320774c479 service nova] Creating event network-vif-plugged:942f8a2a-3638-4bf8-8e3a-abf5a794011d for instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd on hv-cinder-84721 Jun 22 19:50:30.102263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-ba93f87a-9649-4c21-b541-b897ddaeca5d req-5e34a820-827e-4290-bfe5-05320774c479 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028061 Jun 22 19:50:30.102965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 493/1227] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:50:30.107883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:30.108606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:30.162864 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:30.170266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:30.171766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:30.172898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-73d12443-602d-4bf4-9eae-d29fed659ec2 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068890 Jun 22 19:50:30.173428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 494/1228] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:30 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:30.308731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:30.309346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:30.316238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:30.316706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:30.317477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:30.317876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:30.459692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:30.468210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-12b30875-eaa2-4b7f-8042-b55a4e6012c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.163408 Jun 22 19:50:30.468799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 495/1229] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:30 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:31.093565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:31.094604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:31.105979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:31.106688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:31.107974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:31.108731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:31.243923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:31.252009 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42d06d83-d6e1-488a-ba6f-2c50de80241b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165154 Jun 22 19:50:31.252540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 496/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:31.256960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:31.257556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:31.307546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:31.315215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:31.316744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:31.317832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-64cbd7a0-464e-4113-a5d4-4c150e6dc208 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064389 Jun 22 19:50:31.318387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 497/1231] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:31 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:31.487760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:31.488646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:31.497956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:31.498546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:31.499611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:31.500173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:31.638288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:31.645921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b8235398-4c90-4fe2-9ebe-ff10e0dbdfa3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1368 microversion: 2.1 time: 0.164203 Jun 22 19:50:31.646473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 498/1232] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:31 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:32.270132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:32.270727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:32.277595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.278024 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.278801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.279239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.413392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:32.421743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1597cd89-a551-4469-9f84-396ba97d002d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.155689 Jun 22 19:50:32.422283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 499/1233] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:32.426822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:32.427416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:32.482954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:32.490471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:32.491965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:32.493144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e99f250e-6896-407c-8868-dd64ff3309e6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069874 Jun 22 19:50:32.493667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 500/1234] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:32 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:32.666828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:32.667742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:32.677984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.678726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.679980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.680774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.723187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:32.807594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:32.815680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94d40258-9390-4044-8286-e35dfe4764ef tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1557 microversion: 2.1 time: 0.155390 Jun 22 19:50:32.816348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 501/1235] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:32 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:32.833557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:32.834045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:32.835782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:32.842208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.842657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.843436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:32.843851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:32.925021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-382e56cb-8c15-4a14-8b06-4ba62d7e4aee tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095041 Jun 22 19:50:32.925650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 502/1236] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 19:50:32 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:50:33.439666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:33.440337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:33.446314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:33.446770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:33.447536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:33.447966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:33.913804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:33.921759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-41a707c8-a949-4cda-8bec-d831c3d2d16f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.486651 Jun 22 19:50:33.922560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 503/1237] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:33.927878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:33.928508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:33.992526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:33.999822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:34.001368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:34.002472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bf3226d4-63f9-4f54-9eaf-719190ec0eb0 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.079268 Jun 22 19:50:34.003064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 504/1238] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:33 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:34.195426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-1440dfe2-70d8-4a78-a7a1-d493e0d474df req-5b9e3558-c75a-441d-9265-59a59f87b8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b876bf3-5d64-46b3-a37f-8a408ad328dd", "tag": "942f8a2a-3638-4bf8-8e3a-abf5a794011d"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:50:34.203979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1440dfe2-70d8-4a78-a7a1-d493e0d474df req-5b9e3558-c75a-441d-9265-59a59f87b8f1 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:34.204454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-1440dfe2-70d8-4a78-a7a1-d493e0d474df req-5b9e3558-c75a-441d-9265-59a59f87b8f1 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:34.215843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-1440dfe2-70d8-4a78-a7a1-d493e0d474df req-5b9e3558-c75a-441d-9265-59a59f87b8f1 service nova] Creating event network-changed:942f8a2a-3638-4bf8-8e3a-abf5a794011d for instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd on hv-cinder-84721 Jun 22 19:50:34.220867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-1440dfe2-70d8-4a78-a7a1-d493e0d474df req-5b9e3558-c75a-441d-9265-59a59f87b8f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 Jun 22 19:50:34.221740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 505/1239] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:50:34.939555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:34.940404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:34.946891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:34.947373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:34.948358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:34.948858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:35.085973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:35.094121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-92d9ee48-7fe6-4657-9037-ca1fad6f8e68 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.159317 Jun 22 19:50:35.097152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 506/1240] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:35.099343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:35.099963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:35.153654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:35.161239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:35.162743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:35.163846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-474da806-292f-44e1-9885-535e9d340ca1 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068381 Jun 22 19:50:35.164430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 507/1241] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:35 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:35.915057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:50:35.915689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:50:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:50:36.110980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:36.111610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:36.118892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:36.119336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:36.120089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:36.120561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:36.256757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:36.269522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-32b1624d-5583-44f5-a4c3-b6a7cfd9e0b2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162064 Jun 22 19:50:36.270312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 508/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:36.276223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:36.276893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:36.331737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:36.339149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:36.340679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:36.341774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9b51e847-69e9-441a-a0e6-5a8e096a73c5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070412 Jun 22 19:50:36.342336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 509/1243] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:36 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:37.292058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:37.293042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:37.304066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:37.304850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:37.305910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:37.306326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:37.444466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:37.452686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85a7959d-2af5-435e-83dd-58f332d20296 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.167075 Jun 22 19:50:37.453284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 510/1244] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:50:37.457654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:37.458266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:37.509184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:37.516756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:37.518250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:37.519376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c80833ad-d939-4757-8d31-6c3176f12e77 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065195 Jun 22 19:50:37.519924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 511/1245] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:37 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:38.479567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:38.481981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:38.493532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:38.494031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:38.494839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:38.495253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:38.625673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:38.633824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-824498a4-aa22-4182-9ed8-304ccd3608ae tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160833 Jun 22 19:50:38.634417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 512/1246] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:38.638747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:38.639379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:38.693152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:38.700964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:38.702473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:38.703571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-19cbc6f0-aad0-4b0f-8d12-c4001a01986c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.068263 Jun 22 19:50:38.704202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 513/1247] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:38 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:39.655742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:39.656933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:39.666755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:39.667198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:39.667941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:39.668392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:39.806450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:39.814899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6680ab62-28d9-4847-b1e4-b2f203697eef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166482 Jun 22 19:50:39.815484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 514/1248] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:39.820356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:39.821124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:39.872651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:39.874995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=55 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:39.881463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:39.882946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:39.884160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-721edb1e-5c8c-48a4-998f-14766a9cc79b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067552 Jun 22 19:50:39.884721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 515/1249] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:39 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:40.837101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:40.837800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:40.845451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:40.846280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:40.847125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:40.847801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:40.995946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:41.008901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-879c8c83-821c-4ab1-8e4c-5e0464d0cf6b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177976 Jun 22 19:50:41.009808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 516/1250] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:41.016803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:41.017657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:41.077072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:41.084161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:41.085679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:41.086769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ea48bcec-b8b3-49f2-ae4b-65a0834d6109 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.075772 Jun 22 19:50:41.087395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 517/1251] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:41 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:42.035077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:42.036225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:42.044428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:42.044878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:42.045635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:42.046058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:42.183790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:42.187181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:42.194325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-07ab62bf-0a3d-43d7-a0d3-327adcaf5e59 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165768 Jun 22 19:50:42.194905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 518/1252] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:42.199691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:42.200316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:42.255397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:42.262643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:42.264133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:42.265234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8c13f735-2ba7-4a29-a13e-c02da4ffc0e5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069427 Jun 22 19:50:42.265756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 519/1253] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:42 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:43.215133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:43.216437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:43.227727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:43.228537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:43.229800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:43.230613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:43.370723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:43.382512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22a9df45-b23e-4523-8425-127f139631d4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.173875 Jun 22 19:50:43.383717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 520/1254] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:43.388136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:43.389017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:43.438957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:43.446305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:43.447805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:43.448933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-429d8122-b20b-4c1e-ac59-82d3a4729ca4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064250 Jun 22 19:50:43.449500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 521/1255] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:43 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:44.403493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:44.405064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:44.415456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:44.415901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:44.416704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:44.417133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:44.557512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:44.565532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-93ecb1ae-e116-4baf-a3bd-727b66fed544 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168482 Jun 22 19:50:44.566107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 522/1256] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:44 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:44.570483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:44.571079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:44.621839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:44.629150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:44.630672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:44.631786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-eaaebd74-a41d-4e09-a63e-6d790dafe5d5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064743 Jun 22 19:50:44.632366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 523/1257] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:44 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:45.586867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:45.587903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:45.600324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:45.601079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:45.602339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:45.602774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:45.732870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:45.741054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aca388d0-b3c3-48ba-b0bc-61d133260f81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160747 Jun 22 19:50:45.741632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 524/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:45.746011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:45.746612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:45.801601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:45.809031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:45.810528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:45.811626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8abe04fa-46ee-4d27-b9d6-4fccb06ad31a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069085 Jun 22 19:50:45.812234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 525/1259] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:45 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:46.762255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:46.763202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:46.775602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:46.776048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:46.776838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:46.777267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:46.906424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:46.914468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b28f4d56-fc09-4519-b0bc-8e6f2f813639 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.158780 Jun 22 19:50:46.915003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 526/1260] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:46.919453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:46.920048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:46.973282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:46.981136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:46.982618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:46.983705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10f2dc8a-afda-4717-b164-6d1cc50ae0a9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067773 Jun 22 19:50:46.984307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 527/1261] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:46 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:47.934876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:47.935876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:47.947268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:47.947719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:47.948532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:47.948994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:48.087210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:48.099506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4d2c4254-1217-4c01-974d-3d7be679edf6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170943 Jun 22 19:50:48.100427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 528/1262] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:48.104889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:48.105482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:48.154972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:48.162200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:48.163735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:48.164962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7cb82f25-d775-429b-a78e-4c8d0d6b5b26 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063615 Jun 22 19:50:48.165511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 529/1263] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:48 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:49.117081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:49.117797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:49.125458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:49.125903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:49.126662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:49.127089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:49.288322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:49.296399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37078064-acf0-4fd8-abcd-e57cce1b6f8d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.183093 Jun 22 19:50:49.296971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 530/1264] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:49.301391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:49.301991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:49.366889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:49.374143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:49.375627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:49.376743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a839f1d7-332e-4d2e-b703-14fec5a0d079 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.078869 Jun 22 19:50:49.377286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 531/1265] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:49 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:50.315746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:50.316819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:50.327361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:50.327787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:50.328569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:50.329007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:50.466395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:50.474473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b706d29b-40ab-4e15-abd2-165acbbe442b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162972 Jun 22 19:50:50.475047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 532/1266] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:50.479410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:50.480021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:50.534518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:50.546255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:50.547948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:50.549703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3adff37a-f2ae-404f-b964-8b49073ffb12 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073457 Jun 22 19:50:50.550475 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 533/1267] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:50 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:51.494533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:51.495180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:51.503116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:51.503566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:51.504374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:51.504805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:51.647239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:51.655019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0630ec17-24b6-4b58-8a3c-88cc8da068f6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166605 Jun 22 19:50:51.655590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 534/1268] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:51.660288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:51.660888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:51.713114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:51.721174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:51.722750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:51.723784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-232fba35-d241-4e2c-bc30-a59e170e3244 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067273 Jun 22 19:50:51.724374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 535/1269] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:51 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:52.672244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:52.672961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:52.675193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:50:52.681581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:52.682031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:52.682802 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:52.683232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:52.823164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:52.831592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4c540065-d4e4-416b-9ca1-c2e1dab8b1eb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163309 Jun 22 19:50:52.832167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 536/1270] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:52.837061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:52.837697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:52.893526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:52.901045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:52.902554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:52.903649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d9ed2cc0-560d-4db8-bbfd-2782ff9b94b5 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070524 Jun 22 19:50:52.904235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 537/1271] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:52 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:53.853608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:53.854398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:53.863752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:53.864371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:53.865319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:53.865863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:54.003352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:54.011373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-627cc841-e5a4-4939-a52d-43ac743d0905 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.163969 Jun 22 19:50:54.011950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 538/1272] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:54.016542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:54.017144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:54.067190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:54.074576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:54.076056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:54.077163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-47f96e63-0f2c-460b-9673-091705cac08f tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.064217 Jun 22 19:50:54.077748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 539/1273] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:54 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:55.032813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:55.033861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:55.045781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:55.046530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:55.047784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:55.048557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:55.191801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:55.204033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-af9a6120-2dcd-48b6-852c-9eadc65de0ff tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.177559 Jun 22 19:50:55.204885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 540/1274] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:55.211305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:55.211889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:55.262791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:55.270320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:55.271816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:55.272944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-230f06a7-074b-46d4-9a6a-5839cecafdfc tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067049 Jun 22 19:50:55.273547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 541/1275] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:55 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:56.227481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:56.228260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:56.236262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:56.236759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:56.237559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:56.238013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:56.370039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:56.378159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d0673c7-2bfe-4908-8bea-ef964913c102 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157296 Jun 22 19:50:56.378723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 542/1276] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:56.383171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:56.383759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:56.437229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:56.444596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:56.446121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:56.447207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-86dea626-b5f0-4bab-8248-50909271bd8c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067572 Jun 22 19:50:56.447761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 543/1277] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:56 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:57.399576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:57.400781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:57.410755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:57.411488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:57.412789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:57.413496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:57.564546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:57.574310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a62d5e02-a293-40c0-879f-36ed84cfaef4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.181489 Jun 22 19:50:57.574889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 544/1278] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:57.579644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:57.580274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:57.631678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:57.639007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:57.640531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:57.641611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22e155fa-2a78-4782-95b2-80376c945e95 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065796 Jun 22 19:50:57.642160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 545/1279] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:57 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:58.598315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:58.599383 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:58.608030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:58.608516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:58.609278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:58.609711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:58.743790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:58.751479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-be90dcb2-403c-401f-ae31-b03b5a36fe92 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.160976 Jun 22 19:50:58.752060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 546/1280] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:50:58.756542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:58.757200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:58.815746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:58.823063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:58.824762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:58.825868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b066cc71-0665-41a4-b643-a1ba190c8d52 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072873 Jun 22 19:50:58.826396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 547/1281] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:58 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:50:59.772787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:59.773854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:59.782634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:59.783151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:59.784032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:50:59.784567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:50:59.925326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:50:59.937387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2dd26435-db32-41f6-b6c6-5a0b9bf753e0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170988 Jun 22 19:50:59.938214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 548/1282] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:50:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:50:59.942685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:50:59.943267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:50:59.996855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:00.004023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:00.005543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:00.006620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b2dee768-6f75-4616-8f8a-7f2724136558 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067510 Jun 22 19:51:00.007168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 549/1283] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:50:59 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:00.955739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:00.956447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:00.964682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:00.965139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:00.965900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:00.966334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:01.097328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:01.108897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-54752fef-6090-4c32-a275-d329f9df2232 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157270 Jun 22 19:51:01.109733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 550/1284] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:01.114307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:01.114895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:01.166904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:01.178197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:01.180394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:01.181490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-915da2ce-5f1a-4a8b-bbee-60a3a46b234a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.070846 Jun 22 19:51:01.182049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 551/1285] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:01 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:02.130000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:02.131173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:02.139923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:02.140433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:02.141239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:02.141697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:02.156899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:51:02.278916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:02.289655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-17f3d138-08a1-4f3f-9ad5-7925c7a7e77b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.166299 Jun 22 19:51:02.290224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 552/1286] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:02.294704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:02.295302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:02.346617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:02.354013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:02.355508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:02.356725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f9848473-bda9-43aa-bb37-ab313c3d54d6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065557 Jun 22 19:51:02.357382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 553/1287] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:02 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:03.310035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:03.310678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:03.321532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:03.322121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:03.322976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:03.323518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:03.471366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:03.483153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-db99377a-cebc-4026-a745-c6c10c730727 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.179292 Jun 22 19:51:03.483976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 554/1288] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:03.490942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:03.491731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:03.555123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:03.562660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:03.564139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:03.565254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c51a4fa4-1729-43f9-8a03-fb8636ce6a9b tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.080077 Jun 22 19:51:03.565810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 555/1289] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:03 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:04.503544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:04.504164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:04.513783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:04.514227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:04.514981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:04.515402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:04.648791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:04.656893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0e931790-0584-43ea-a094-8a0b438e3a7f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.157248 Jun 22 19:51:04.657632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 556/1290] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:04.662010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:04.662604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:04.719367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:04.730898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:04.733280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:04.734934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-63e5bd0b-38fd-4146-8ae2-25128c58283c tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.076098 Jun 22 19:51:04.735684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 557/1291] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:04 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:05.678227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:05.679276 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:05.687496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:05.687971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:05.688808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:05.689291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:05.825888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:05.834178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-86081742-2850-4ea6-81db-d508fe0a8a06 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162477 Jun 22 19:51:05.834729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 558/1292] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:05.839315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:05.839924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:05.894974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:05.902696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:05.904247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:05.905358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f5fed68a-631f-49d9-b025-152e8eb37748 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.069654 Jun 22 19:51:05.905926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 559/1293] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:05 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:06.855522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:06.856600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:06.868790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:06.869540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:06.870797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:06.871521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:07.011200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:07.019334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-740bbe48-bc78-4f0b-bd7c-7aada3a6771a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.170667 Jun 22 19:51:07.019928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 560/1294] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:07.024489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:07.025081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:07.078321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:07.086100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:07.087592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:07.088725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fca37e76-9ff3-4033-8a9e-9006c6a67838 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.067848 Jun 22 19:51:07.089278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 561/1295] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:07 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:08.036298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:08.036979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:08.044551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:08.044994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:08.045749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:08.046177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:08.190356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:08.198280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-abf72379-e947-4e94-8f13-11e6d32d8452 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.165977 Jun 22 19:51:08.198848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 562/1296] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:08.203205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:08.203800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:08.258410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:08.269073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:08.271361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:08.272674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8e301d81-d8f2-4e5e-9301-471d4d319e7a tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.072740 Jun 22 19:51:08.273476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 563/1297] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:08 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:09.219547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:09.221023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:09.233636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:09.234368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:09.235755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:09.236514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:09.374338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:09.381868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-55e209f4-27e7-421b-aa07-3388679eeb8a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.168725 Jun 22 19:51:09.382429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 564/1298] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:09.386841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:09.387432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:09.437452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:09.444673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:09.446138 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:09.447223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-294c8c55-183e-420d-bcc1-430b435401fd tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.063908 Jun 22 19:51:09.447776 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 565/1299] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:09 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:10.399993 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:10.400644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:10.408423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:10.408879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:10.409645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:10.410075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:10.545414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:10.558201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d9a9ecc3-57c8-4362-9271-f54523d2515f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161907 Jun 22 19:51:10.559252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 566/1300] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:10.566399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:10.567300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:10.622544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:10.624770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=52 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:51:10.630879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:10.632452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:10.633588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2d51d310-4210-4ba8-bf94-9d568f1721c4 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.073283 Jun 22 19:51:10.634113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 567/1301] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:10 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:11.584286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:11.585280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:11.595080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:11.595527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:11.596645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:11.597076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:11.727905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:11.739747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-96386d92-07ed-4699-981f-1b723aeed901 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.162016 Jun 22 19:51:11.740758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 568/1302] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:51:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:51:11.745015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:11.745613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:11.752090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:51:11.798100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:11.805649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:11.807141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:51:11.808289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4ef63de3-50d6-48b1-b35b-4d34c580325d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.066856 Jun 22 19:51:11.808844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 569/1303] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:51:11 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:51:12.729240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:51:12.730311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:51:12.740772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:12.741517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:12.742788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:51:12.743489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:51:21.802394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:51:22.736188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:51:22.806884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=55 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:04.347803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:52:04.348679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:52:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:52:12.861817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 19:52:13.033633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:52:13.415653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:52:13.418224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:52:13.419823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:52:13.420725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:52:13.421974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:13.423445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:13.424711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) Jun 22 19:52:13.426055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:52:13.427767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b77ec692-a6c1-4213-b007-0d887117476e) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:52:13.427767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f8438394-775d-4be6-8f58-ad9fa238cfb8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 60.698570 Jun 22 19:52:13.427767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 570/1304] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:51:12 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 60700 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:52:13.525272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:13.525877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:13.532735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.533176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.533929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.534350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.673488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:13.682161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f79fdd33-7cd7-4515-9427-561d9662cef8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.259737 Jun 22 19:52:13.682727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 571/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:13.687146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:13.687752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:13.738755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:13.746322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:13.747820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:13.748995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e0e7fb94-cdc6-4f5e-9a89-9fa263dae0c9 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.065315 Jun 22 19:52:13.749552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 572/1306] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:52:13 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:52:13.753884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:13.754369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:13.760198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.760649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.761404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.761833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.786184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-13bdd84b-6aec-4d10-a072-1799d8a5b81f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd/ips" status: 200 len: 149 microversion: 2.1 time: 0.035672 Jun 22 19:52:13.786731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 573/1307] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 19:52:13 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:52:13.791057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:13.791540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:13.797889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.798319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.799080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.799533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.874497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57984. Jun 22 19:52:13.881006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e5e76077-f458-4663-a8ea-c3361adb65ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 202 len: 0 microversion: 2.1 time: 121.214581 Jun 22 19:52:13.881956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 735/1308] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:50:12 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 0 bytes in 121216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:52:13.891340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:13.892561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:13.902184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.902689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:13.903463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:13.903904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:14.037507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:14.045364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-78cb6d0d-13da-4657-aaca-583751e1d1a9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.161863 Jun 22 19:52:14.045929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 736/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:13 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:14.050435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.051031 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:14.135041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:14.143202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:14.144767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef6f7c907b407b9d76bc814749d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90964fa17494782b2a49ff54cfede88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:14.146125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1d4531a6-4ea6-4480-9786-03c501ded579 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 200 len: 1280 microversion: 2.20 time: 0.098966 Jun 22 19:52:14.147033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 737/1310] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:52:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 19:52:14.151433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.151942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:14.159229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:14.159945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:14.161249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:14.161951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:14.187211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:52:14.268502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ace05504-dec0-4dff-a258-208383922ef1 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 204 len: 0 microversion: 2.1 time: 0.120106 Jun 22 19:52:14.269211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 738/1311] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:52:14 2022] DELETE /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:52:14.275598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-76228fd0-6b7e-4299-b6d2-4db9ae467391 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.276196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-76228fd0-6b7e-4299-b6d2-4db9ae467391 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:14.292681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-76228fd0-6b7e-4299-b6d2-4db9ae467391 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:52:14.461172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.scheduler.client.report [None req-76228fd0-6b7e-4299-b6d2-4db9ae467391 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Deleted allocations for instance ed47d46c-d951-4a22-b9d6-5ff7d701416b Jun 22 19:52:14.477874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-76228fd0-6b7e-4299-b6d2-4db9ae467391 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 204 len: 0 microversion: 2.20 time: 0.207321 Jun 22 19:52:14.478483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 739/1312] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jun 22 19:52:14 2022] DELETE /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 19:52:14.486152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.486758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:14.492839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:14.493135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:14.493912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:14.494351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:14.749703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:14.758226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8ab8261d-a13c-4999-9302-a165e7f083c6 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1504 microversion: 2.1 time: 0.275766 Jun 22 19:52:14.759132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 740/1313] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:14 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:14.764603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.765463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: ed47d46c-d951-4a22-b9d6-5ff7d701416b] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:14.781060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b HTTP/1.1 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:52:14.783955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. Jun 22 19:52:14.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'ed47d46c-d951-4a22-b9d6-5ff7d701416b'} Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance ed47d46c-d951-4a22-b9d6-5ff7d701416b Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:52:14.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:52:14.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance ed47d46c-d951-4a22-b9d6-5ff7d701416b could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:52:14.795282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ebbab4b8-89c8-4af4-a5ea-1a52e096c783 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b" status: 404 len: 111 microversion: 2.20 time: 0.025413 Jun 22 19:52:14.796365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 741/1314] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 19:52:14 2022] GET /compute/v2.1/servers/ed47d46c-d951-4a22-b9d6-5ff7d701416b => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:52:14.796365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d2ed9c05-90d0-4f84-bcab-c1c03f6f4b6d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '.version_select at 0x7fdc19d6a1f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:14.819050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d2ed9c05-90d0-4f84-bcab-c1c03f6f4b6d tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382469645" status: 204 len: 0 microversion: 2.20 time: 0.027300 Jun 22 19:52:14.819703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 742/1315] 10.222.0.26 () {60 vars in 1258 bytes} [Wed Jun 22 19:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382469645 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 19:52:15.115430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:15.116741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:15.123762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.124669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.125707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.126491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.156619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:52:15.255719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-586e320f-78a2-4d87-9eb5-8124d48c3258 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 204 len: 0 microversion: 2.1 time: 0.144166 Jun 22 19:52:15.260405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 743/1316] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:52:15 2022] DELETE /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 19:52:15.329318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-f4d14deb-884f-4315-ac53-3706e3f3e405 req-88ed0590-3bcf-4611-af80-2934061e950c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:52:15.337837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f4d14deb-884f-4315-ac53-3706e3f3e405 req-88ed0590-3bcf-4611-af80-2934061e950c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.338284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f4d14deb-884f-4315-ac53-3706e3f3e405 req-88ed0590-3bcf-4611-af80-2934061e950c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.350924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-f4d14deb-884f-4315-ac53-3706e3f3e405 req-88ed0590-3bcf-4611-af80-2934061e950c service nova] Creating event network-changed:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:52:15.356497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-f4d14deb-884f-4315-ac53-3706e3f3e405 req-88ed0590-3bcf-4611-af80-2934061e950c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093919 Jun 22 19:52:15.357416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 744/1317] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:52:15.362719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:15.363425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:15.370638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.371097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.372135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.372619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.678041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:15.686001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4bd1eac1-c896-4026-8589-bf66e2e6d9c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1567 microversion: 2.1 time: 0.327349 Jun 22 19:52:15.686587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 745/1318] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:15.778674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:15.779453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:15.785781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.786749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.787261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.787820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.896291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e7c53907134ea9ba292e87d9f4f35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2daf1dbea77346099900900d36c8618e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:15.907800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-22a6d8c3-c642-49fd-9b25-52601673e1a5 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 200 len: 1462 microversion: 2.1 time: 0.133849 Jun 22 19:52:15.910083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 746/1319] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:15 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 1462 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:52:15.914957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-10463700-4a03-4376-b915-e063f88c0cf5 req-36084f32-2e6a-471e-bdac-aa30567ea7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db34ecf0-0253-4fcd-9ad7-45e29ebaeff1", "name": "network-vif-deleted", "tag": "ed261e9e-6ed3-496c-88bc-d75e33074bda"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:52:15.928607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-10463700-4a03-4376-b915-e063f88c0cf5 req-36084f32-2e6a-471e-bdac-aa30567ea7fa service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:15.929829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-10463700-4a03-4376-b915-e063f88c0cf5 req-36084f32-2e6a-471e-bdac-aa30567ea7fa service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:15.943505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-10463700-4a03-4376-b915-e063f88c0cf5 req-36084f32-2e6a-471e-bdac-aa30567ea7fa service nova] Creating event network-vif-deleted:ed261e9e-6ed3-496c-88bc-d75e33074bda for instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 on hv-cinder-84721 Jun 22 19:52:15.948800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-10463700-4a03-4376-b915-e063f88c0cf5 req-36084f32-2e6a-471e-bdac-aa30567ea7fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037224 Jun 22 19:52:15.949425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 747/1320] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:52:16.707769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:16.709293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:16.717202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:16.717647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:16.718413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:16.718874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:16.851872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:16.859600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5f6779f8-4edf-48aa-9284-357ab6054ca3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.158972 Jun 22 19:52:16.860250 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 748/1321] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:16.933015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:16.934014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] [instance: db34ecf0-0253-4fcd-9ad7-45e29ebaeff1] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:16.943742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:16.944549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:16.945832 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:16.946590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:16.965633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] HTTP exception thrown: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Request method failure captured: Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 HTTP/1.1 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3CxMDTIopbYpiLZCeT0xmit6SNGcqaaB2CHGUQlU69A_O_o9P58JiVaOe8Xu0QL6MJHljhA1W4aoI9gImVjVXW_DtgDZ0geM0ozDCxOnqDIX4-9nn5GljwNnk0GrkcuwzVW9dfan7nQdczfC9qh7wVUAw98ykG7y2ejwL8iL3Jrg94 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 2daf1dbea77346099900900d36c8618e Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesActionsTest-1776622320 Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:52:16.967294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2daf1dbea77346099900900d36c8618e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2daf1dbea77346099900900d36c8618e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2daf1dbea77346099900900d36c8618e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2daf1dbea77346099900900d36c8618e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesActionsTest-1776622320 Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 2daf1dbea77346099900900d36c8618e Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesActionsTest-1776622320 Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesActionsTest-1776622320-project Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: a4e7c53907134ea9ba292e87d9f4f35d Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesActionsTest-1776622320-project Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. Jun 22 19:52:16.968896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'db34ecf0-0253-4fcd-9ad7-45e29ebaeff1'} Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:52:16.969807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. Jun 22 19:52:16.971586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:52:16.972842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] Returning 404 to user: Instance db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:52:16.972842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5544a04a-a19d-4b5c-a5ca-bd4699ee8db2 tempest-VolumesActionsTest-1776622320 tempest-VolumesActionsTest-1776622320-project] 10.222.0.26 "GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1" status: 404 len: 111 microversion: 2.1 time: 0.042089 Jun 22 19:52:16.972842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 749/1322] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:16 2022] GET /compute/v2.1/servers/db34ecf0-0253-4fcd-9ad7-45e29ebaeff1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:52:17.877643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:17.878388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:17.885479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:17.885924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:17.886691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:17.887122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:18.031880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:18.039909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-93233c27-3c3f-43a6-9d0b-a4a276401a90 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.166593 Jun 22 19:52:18.040504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 750/1323] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:19.061292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:19.062781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:19.075648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:19.076404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:19.077707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:19.078423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:19.226664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:19.234841 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34e9c138-1229-48fd-af02-1bd1ceb3f8b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.180259 Jun 22 19:52:19.235384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 751/1324] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:20.254798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:20.255867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:20.263342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:20.263782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:20.264573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:20.264996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:20.404569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:20.415982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a24b09a7-ea7b-4668-85a7-25edcc9cf33f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.167420 Jun 22 19:52:20.416867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 752/1325] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:21.438074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:21.438817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:21.445724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:21.446176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:21.446937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:21.447370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:21.581017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:21.590872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34ffdc64-de9b-49f0-8990-77f1432ea4c7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.156467 Jun 22 19:52:21.591704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 753/1326] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:21 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:22.612536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:22.613551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:22.624524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:22.625266 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:22.626505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:22.627208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:22.759309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:22.762837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:22.767183 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-557ad9a1-b170-4fa5-b623-1e4f5020a92c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.161050 Jun 22 19:52:22.767745 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 754/1327] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:23.743624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:23.785953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:23.786712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:23.794664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:23.795117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:23.795261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=10 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:23.795916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:23.796407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:23.817740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=18 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:23.933224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:23.945060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a2e12e12-7f96-4c12-9538-24bb13c4305c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.163600 Jun 22 19:52:23.945633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 755/1328] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:24.971264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:24.972384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:24.975337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:24.985255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:24.985982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:24.987279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:24.987971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:25.122431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:25.134493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52f1faf9-dc11-4724-b177-7151cd6b7683 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.169809 Jun 22 19:52:25.135217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 756/1329] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:26.160776 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:26.161796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:26.169527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:26.169976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:26.170740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:26.171168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:26.318872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:26.326978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f7dcec81-9337-4c61-931f-0475987ea0d9 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.172903 Jun 22 19:52:26.327549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 757/1330] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:27.352400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:27.353438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:27.364371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:27.365117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:27.366365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:27.367115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:27.506502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:27.514474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e8120831-5147-439e-958d-7f7a1ae04a44 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.168899 Jun 22 19:52:27.515020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 758/1331] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:28.535790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:28.536785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:28.545131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:28.545635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:28.546488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:28.546972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:28.696182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:28.704548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f4877a50-6947-4e5e-a505-5b7fee464cde tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.175260 Jun 22 19:52:28.705124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 759/1332] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:28 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:29.725758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:29.726662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:29.736813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:29.737502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:29.738668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:29.739339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:29.870673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:29.878500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-241aa9a9-4157-4cf4-9154-d5189870d46a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.159360 Jun 22 19:52:29.879066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 760/1333] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:30.899333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:30.899985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:30.906719 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:30.907192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:30.907955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:30.908416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:31.046462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:31.054798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8aafd21b-6fc3-4937-834d-709f2b35196d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.161268 Jun 22 19:52:31.055385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 761/1334] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:30 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:32.076510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:32.077577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:32.088604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:32.089364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:32.090620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:32.091341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:32.235684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:32.243391 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a6547698-ab7e-466e-a59e-94c04fdc9462 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.173522 Jun 22 19:52:32.243945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 762/1335] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:33.263654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:33.265102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:33.275129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:33.275584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:33.276395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:33.276831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:33.411715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:33.423439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e4356bdc-d8e3-491c-804d-495f66ff7262 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.165763 Jun 22 19:52:33.424182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 763/1336] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:33 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:34.447165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:34.448396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:34.458500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:34.459236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:34.460606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:34.461322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:34.617407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:34.625405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3b4d59da-8568-431a-87df-45cf087c1109 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.185104 Jun 22 19:52:34.625980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 764/1337] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:35.644157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:35.644892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:35.652459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:35.652905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:35.653661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:35.654086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:35.792453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:35.800767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bda4e251-9ef9-4177-ba9f-871728bf50ca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.161528 Jun 22 19:52:35.801336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 765/1338] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:35 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:36.821569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:36.822247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:36.829363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:36.829833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:36.830630 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:36.831081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:36.969456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:36.977485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9691ed79-c4b0-43de-9f2c-bbb3191df0e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.162786 Jun 22 19:52:36.978058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 766/1339] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:37.996061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:37.996799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:38.003352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:38.003788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:38.004615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:38.005065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:38.144241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:38.152415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cbf39eb7-3dbd-4df5-b037-ae709dde1b34 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.160844 Jun 22 19:52:38.152956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 767/1340] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:39.173929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:39.175012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:39.183703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:39.184207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:39.184969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:39.185408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:39.328213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:39.338702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-57e32189-a208-4078-be84-571835d3b6b5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.171454 Jun 22 19:52:39.339245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 768/1341] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:40.357346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:40.358363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:40.361768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:40.369913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:40.370876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:40.372090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:40.373037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:40.515220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:40.526781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b50863b6-cc52-4435-894b-e78e3898413e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.174778 Jun 22 19:52:40.527572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 769/1342] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:41.544307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:41.544983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:41.551794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:41.552267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:41.553025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:41.553450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:41.687422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:41.695177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af236816-bc1b-4144-af74-7466f9fd8fc5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.154914 Jun 22 19:52:41.695743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 770/1343] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:41 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:42.721473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:42.722492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:42.730918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:42.731371 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:42.732141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:42.732613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:42.751091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:52:42.881020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:42.888711 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5850d2e0-a07e-424c-9ad5-0c4d8f0d1200 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.174356 Jun 22 19:52:42.889284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 771/1344] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:43.913048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:43.914101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:43.924851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:43.925580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:43.926825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:43.927532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:44.064326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:44.072135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c9993f0c-8590-4057-99a9-5ef9b6743391 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.165820 Jun 22 19:52:44.072742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 772/1345] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:45.098279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:45.099364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:45.107221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:45.107671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:45.108469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:45.108903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:45.241825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:45.250166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34a3f9e0-1f0b-4416-9a12-035deda0e7c2 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.158828 Jun 22 19:52:45.250738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 773/1346] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:46.275925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:46.277079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:46.288212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:46.289060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:46.289850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:46.290276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:46.427684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:46.439627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cbf28151-017a-4b7e-b9b7-e581a71e10f1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.169849 Jun 22 19:52:46.440413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 774/1347] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:47.461329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:47.462032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:47.468944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:47.469396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:47.470483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:47.470913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:47.600636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:47.611383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-79a91b74-c2ae-4040-9dab-17ff69c4d9f8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.155503 Jun 22 19:52:47.612234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 775/1348] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:48.634613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:48.635609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:48.646275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:48.647005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:48.648288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:48.649129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:48.800084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:48.811465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bdbff726-10c2-4d61-8051-29458157480b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.183147 Jun 22 19:52:48.812272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 776/1349] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:49.835967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:49.836731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:49.844248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:49.844741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:49.845904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:49.846375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:49.979157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:49.990642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a795a3e7-1050-4da8-b52b-89ef9e2029e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.160959 Jun 22 19:52:49.991431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 777/1350] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:51.012933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:51.014046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:51.025440 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:51.026182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:51.027433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:51.028186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:51.163943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:51.175539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0c02aa52-8d3c-4cae-8b89-96a8053eeef0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.168808 Jun 22 19:52:51.176430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 778/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:52.195453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:52.196322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:52.205461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:52.206052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:52.207077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:52.207721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:52.362073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:52.370337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-40dfe199-dc15-449e-b4e5-9fc0317a67bf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.180320 Jun 22 19:52:52.370910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 779/1352] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:53.394181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:53.395273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:53.403204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:53.403647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:53.404441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:53.404871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:53.540148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:53.551798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ad2fa1cf-6343-4836-a404-269bf85fc801 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.163713 Jun 22 19:52:53.552700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 780/1353] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:54.572628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:54.573258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:54.580075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:54.580545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:54.581301 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:54.581727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:54.730191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:54.738055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-188b9f20-3663-409d-94e5-6d628cb4a37d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.170772 Jun 22 19:52:54.740131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 781/1354] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:54 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:55.759267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:55.760270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:55.771227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:55.771978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:55.773329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:55.773759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:55.906164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:55.914058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e6991e6a-e1aa-46c8-96df-3d5e9c6afc31 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.161253 Jun 22 19:52:55.914640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 782/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:56.938061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:56.939053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:56.948282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:56.948759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:56.949524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:56.949952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:57.085728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:57.093793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d998444d-885f-4c85-9483-f627825e258a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.164283 Jun 22 19:52:57.094358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 783/1356] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:58.114667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:58.115736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:58.123332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:58.123810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:58.124621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:58.125056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:58.267845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:58.279580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6598033c-e943-40a8-8337-70b1e585fb81 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.171098 Jun 22 19:52:58.280432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 784/1357] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:52:59.302447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:52:59.303097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:52:59.313312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:59.313919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:59.314958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:52:59.315481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:52:59.458136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:52:59.466152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b27683ba-a203-42f9-a795-965b893574d1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.169840 Jun 22 19:52:59.466923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 785/1358] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:52:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:00.487229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:00.488322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:00.496560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:00.497009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:00.497777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:00.498210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:00.635504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:00.647691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-453e50c0-1afd-4291-a574-2dcde4c8798f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.166522 Jun 22 19:53:00.648518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 786/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:01.669586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:01.670253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:01.677194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:01.677640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:01.678393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:01.678821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:01.822017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:01.834144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-01fa1b7a-9548-4e07-8216-738ef76a5211 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.168299 Jun 22 19:53:01.834683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 787/1360] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:02.855464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:02.856557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:02.867320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:02.868071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:02.869379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:02.870103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:02.876718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:53:03.018401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:03.030135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-67c8f69d-80de-4e71-bc4d-07ac6b8a812b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.181211 Jun 22 19:53:03.030999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 788/1361] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:04.052539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:04.053223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:04.060255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:04.060706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:04.061472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:04.061908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:04.216169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:04.227327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b647cf01-a758-4e02-bde8-73bb10a72156 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.180218 Jun 22 19:53:04.228132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 789/1362] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:04 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:05.252968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:05.254062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:05.261968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:05.262448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:05.263201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:05.263633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:05.398781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:05.406455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1846528-7de5-4324-a20c-a0c5a935b863 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.159896 Jun 22 19:53:05.407026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 790/1363] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:06.427072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:06.428182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:06.435430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:06.435872 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:06.436662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:06.437088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:06.569152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:06.577159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6902f613-d502-414c-9e44-5389ce5c182f tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.156732 Jun 22 19:53:06.577727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 791/1364] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:07.598581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:07.599548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:07.607686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:07.608219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:07.609056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:07.609532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:07.750689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:07.762492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fe6c14e7-6758-4bb1-9e07-b75e9ac62806 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.170468 Jun 22 19:53:07.763232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 792/1365] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:08.783128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:08.783744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:08.791029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:08.791478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:08.792274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:08.792705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:08.930916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:08.938879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4f49b971-a2a3-41bd-9326-2eee488b2f3a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.159756 Jun 22 19:53:08.939442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 793/1366] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:09.960959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:09.961673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:09.968868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:09.969318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:09.970409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:09.970844 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:10.104707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:10.115324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0a5dc13-95cc-4824-8eda-58d242494997 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.160437 Jun 22 19:53:10.116435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 794/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:11.134678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:11.135390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:11.137652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=52 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:53:11.143457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:11.143902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:11.144692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:11.145123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:11.286704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:11.294352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6db940a4-f0b1-4b98-b4cc-0d89d1d85822 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.164670 Jun 22 19:53:11.294917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 795/1368] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:12.320907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:12.321994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:12.332773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:12.333500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:12.334747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:12.335445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:12.471937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:53:12.479918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b3e7d020-ec93-4a41-9bd2-69204bd11796 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.165490 Jun 22 19:53:12.480526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 796/1369] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:53:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:53:12.916576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:53:12.917146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:53:12.923716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:12.924165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:12.925015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:53:12.925362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:53:22.921290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=5 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:53:22.944520 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=56 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:53:55.930061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:53:55.931176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:54:13.693721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:54:13.924894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:54:23.698904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:54:23.936171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:55:24.359681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:55:24.360892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:55:26.774906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:55:26.775691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:55:34.727985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:55:34.729136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:55:50.348927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:55:50.349572 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:55:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:56:14.037077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:56:14.039362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.041052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.041683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.044055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.046068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.048465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) Jun 22 19:56:14.052652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.054752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-52911b78-998f-4d6d-abee-1388af674aa7) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:56:14.054752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3ba89d73-b837-4e25-81d3-342bde6aad19 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 240.255121 Jun 22 19:56:14.054752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 574/1370] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:52:13 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 240257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:56:14.054752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:14.055563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:14.062004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.062596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.063478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.064071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.113168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:56:14.115970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.117304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.117933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.118949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.120147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.121603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) Jun 22 19:56:14.122788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.124029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55221bfd-394b-4587-8231-cd5653cc03e6) {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:56:14.124029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-825f64b4-d854-4b24-ac8d-e8011574cc61 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 181.277241 Jun 22 19:56:14.124029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 797/1371] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:53:12 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 181281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:56:14.210142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:14.219683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24264d5a-75ca-42a1-8179-3fd7da560b27 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1449 microversion: 2.1 time: 0.173862 Jun 22 19:56:14.220300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 575/1372] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:14.225277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:14.225975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:14.233801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.234600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.235531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.236143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.265151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:14.266575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:14.273590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.274141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.275000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.275505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.301495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:56:14.374587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 19:56:14.584744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:56:14.651533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:56:14.653803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:14.655367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.656378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:14.657666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.658855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.660019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) Jun 22 19:56:14.661353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:14.662548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc7aec0e-88eb-4126-9a89-6012ffcbbe8b) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:56:14.662548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-34a7d300-97ce-4ae3-8498-3a64f97c3d3a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 0.433795 Jun 22 19:56:14.662548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 576/1373] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:56:14 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 435 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:56:14.662548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:14.662912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:14.668304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.668778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.669737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.670219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.916324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:14.924190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-828b9406-957f-4cab-8106-1d94dc7820fe tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1443 microversion: 2.1 time: 0.266807 Jun 22 19:56:14.924761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 577/1374] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1443 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:14.929200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:14.929911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:14.935973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.936480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.937451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:14.937891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:14.964625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:56:15.017833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.compute.api [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Instance is already in deleting state, ignoring this request Jun 22 19:56:15.018649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ed672a2-7de9-43b1-9acb-cc97aabb5db1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 204 len: 0 microversion: 2.1 time: 0.092997 Jun 22 19:56:15.019531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 578/1375] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:56:14 2022] DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:56:15.023885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.024456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.030233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.030666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.031503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.031928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.120622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:56:15.195264 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:56:15.197751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:56:15.199556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:15.200307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:56:15.201540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:15.203027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:15.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) Jun 22 19:56:15.205440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:56:15.208826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-61e1d4fd-4ae9-4b02-952c-09b03bfdd646) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:56:15.209711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-65fa5ad8-8b08-4af3-96f6-a50334988b94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 0.189568 Jun 22 19:56:15.210287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 579/1376] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:56:15 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:56:15.215804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.216442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.223653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.224153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.225152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.225580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.303659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:15.313644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3b4266e4-7fde-43ce-918c-7e2057f0d9af tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1375 microversion: 2.1 time: 0.101747 Jun 22 19:56:15.314604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 580/1377] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1375 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:15.319654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.320579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.327654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.328431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.329232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.329673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.356964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:56:15.384074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 58294. Jun 22 19:56:15.411277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.compute.api [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Instance is already in deleting state, ignoring this request Jun 22 19:56:15.412134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-63313d18-9695-46f4-a402-740c0d3657de tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 204 len: 0 microversion: 2.1 time: 0.096366 Jun 22 19:56:15.412710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 581/1378] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:56:15 2022] DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:56:15.417769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.418260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.424043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9bc13d75-a448-400a-915d-d12df54b5410 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 204 len: 0 microversion: 2.1 time: 1.302127 Jun 22 19:56:15.424534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.424975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.425403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 798/1379] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:56:14 2022] DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 0 bytes in 1304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:56:15.425741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.426172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.430953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.431787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.437881 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.439347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.440267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.440804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.520565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:15.530398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dceebe55-bef2-4780-9e37-0015419a2432 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.103514 Jun 22 19:56:15.531138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 799/1380] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:15.536056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.537228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.545044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.545492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.546270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.546688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.572443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 19:56:15.635618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.compute.api [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Instance is already in deleting state, ignoring this request Jun 22 19:56:15.636536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-03c78ea6-f732-4bd5-8bff-06f51f9215c7 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 204 len: 0 microversion: 2.1 time: 0.104191 Jun 22 19:56:15.637111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 800/1381] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 19:56:15 2022] DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 19:56:15.641833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.642840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.649105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.649559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.650331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.650760 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.683586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0cc1ee6b-d8bd-44c9-877c-13c1885e55c6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Jun 22 19:56:15.684182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 801/1382] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:15.758097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-987e3c94-1e86-41b5-8c1e-cb99e951717c req-1c96b576-c6b4-43c5-8c75-b1419dce9977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd94079a-3077-4049-b0a1-f51dfdb0b821", "name": "network-vif-deleted", "tag": "8309375b-7f2b-4a4b-ac31-0894ed1f5fcd"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:15.766608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-987e3c94-1e86-41b5-8c1e-cb99e951717c req-1c96b576-c6b4-43c5-8c75-b1419dce9977 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.767037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-987e3c94-1e86-41b5-8c1e-cb99e951717c req-1c96b576-c6b4-43c5-8c75-b1419dce9977 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.777950 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-987e3c94-1e86-41b5-8c1e-cb99e951717c req-1c96b576-c6b4-43c5-8c75-b1419dce9977 service nova] Creating event network-vif-deleted:8309375b-7f2b-4a4b-ac31-0894ed1f5fcd for instance bd94079a-3077-4049-b0a1-f51dfdb0b821 on hv-cinder-84721 Jun 22 19:56:15.782851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-987e3c94-1e86-41b5-8c1e-cb99e951717c req-1c96b576-c6b4-43c5-8c75-b1419dce9977 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097334 Jun 22 19:56:15.783365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 802/1383] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:15.788342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:15.789030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:15.798078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.798532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.799340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:15.799772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:15.936635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:15.944767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-937bb285-e9c8-45d1-b261-86ff8eeb7a9f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1682 microversion: 2.1 time: 0.160241 Jun 22 19:56:15.945660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 803/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:15 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:16.549256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:16.549932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:16.557246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.557723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:16.558498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.558934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:16.622008 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:16.629696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c9056464-e092-49f5-91e5-51e6f431921a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.084764 Jun 22 19:56:16.630279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 804/1385] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:16 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:16.695133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:16.696136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:16.702958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.703409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:16.704187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.704616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:16.734257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c37dec2f-ddc9-4183-acb8-ad18d788c523 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Jun 22 19:56:16.734802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 805/1386] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:16.962793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:16.963319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:16.970072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.970531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:16.971298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:16.971728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.034268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:17.041856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eb2233f1-5420-430b-86d2-54f172d42648 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 200 len: 1614 microversion: 2.1 time: 0.083118 Jun 22 19:56:17.042440 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 806/1387] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:16 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:17.646906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:17.648327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:17.656346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:17.656794 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.657556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:17.657990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.729389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:17.737522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4bb09fcc-0a93-4852-9249-c98c894e9142 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.094729 Jun 22 19:56:17.738099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 807/1388] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:17 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:17.751481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:17.752581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:17.761114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:17.761582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.762394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:17.762832 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.792838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-435f809d-52e2-4ff0-a317-45c03ad4621e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048469 Jun 22 19:56:17.793728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 808/1389] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:17.799808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-ea995436-4f18-44b2-859f-d9186c93af14 req-2c5402f3-b3ab-49fe-8d68-ff6aea01f435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b876bf3-5d64-46b3-a37f-8a408ad328dd", "name": "network-vif-deleted", "tag": "942f8a2a-3638-4bf8-8e3a-abf5a794011d"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:17.808158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-ea995436-4f18-44b2-859f-d9186c93af14 req-2c5402f3-b3ab-49fe-8d68-ff6aea01f435 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:17.808607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-ea995436-4f18-44b2-859f-d9186c93af14 req-2c5402f3-b3ab-49fe-8d68-ff6aea01f435 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:17.819491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-ea995436-4f18-44b2-859f-d9186c93af14 req-2c5402f3-b3ab-49fe-8d68-ff6aea01f435 service nova] Creating event network-vif-deleted:942f8a2a-3638-4bf8-8e3a-abf5a794011d for instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd on hv-cinder-84721 Jun 22 19:56:17.824587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-ea995436-4f18-44b2-859f-d9186c93af14 req-2c5402f3-b3ab-49fe-8d68-ff6aea01f435 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029642 Jun 22 19:56:17.825336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 809/1390] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:18.060160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:18.060915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:18.067538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.067989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.068808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.069239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.082751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd HTTP/1.1 Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:56:18.084420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 19:56:18.086042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '9b876bf3-5d64-46b3-a37f-8a408ad328dd'} Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:56:18.087150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 19:56:18.088383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:56:18.089705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:56:18.089705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0bcff1b-b7c4-4c6c-9759-5c7e7626ed96 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 404 len: 111 microversion: 2.1 time: 0.029970 Jun 22 19:56:18.089705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 810/1391] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:18 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 19:56:18.094658 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a1157fda-3ef9-42ef-ac3c-f4c40e7023c9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '.version_select at 0x7fdc1e535d30>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:18.116871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a1157fda-3ef9-42ef-ac3c-f4c40e7023c9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072458257" status: 202 len: 0 microversion: 2.1 time: 0.026014 Jun 22 19:56:18.117340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 811/1392] 10.222.0.26 () {58 vars in 1220 bytes} [Wed Jun 22 19:56:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072458257 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:56:18.755645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:18.756307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:18.764261 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.764925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.765863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.766298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.827029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:18.834975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-167a915b-f869-4d50-a4c7-6ad69a51a913 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.083976 Jun 22 19:56:18.835538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 812/1393] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:18 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:18.840002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7c8a0f1d-a575-4e86-b13f-8827fdf68813 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: .version_select at 0x7fdc1e5353a0>, body: {"keypair": {"name": "tempest-keypair-1155591304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB02hJuWkNqsNsp66I6CIVpMylDtzYtO8WLFS2K2Tg4C6f+dtb5kKM3udwVMV//udwb8Ny0UzbIStIDWRGPY+CIlqGP9NN2Gw6+WYB7DlHl+dd6XMoy+TyfraXvSCxtkA=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:18.854335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7c8a0f1d-a575-4e86-b13f-8827fdf68813 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:56:18.858533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7c8a0f1d-a575-4e86-b13f-8827fdf68813 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:56:18.884661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7c8a0f1d-a575-4e86-b13f-8827fdf68813 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047751 Jun 22 19:56:18.885431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 813/1394] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 19:56:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:18.890065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:18.890976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:18.896955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.897408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.898179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:18.898615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:18.928795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e5bec55a-a691-437a-afe3-e751eb9bc531 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jun 22 19:56:18.929432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 814/1395] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:19.851577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:19.852223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:19.858973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:19.859423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:19.860222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:19.860655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:19.878858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:19.936975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:19.944816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-913a9882-b755-4fe0-96d9-b5aece626a95 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.097161 Jun 22 19:56:19.945396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 815/1396] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:19 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:19.950088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:19.951056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:19.957018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:19.957472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:19.958243 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:19.958673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:19.990136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e129725a-6ad8-400d-bf14-65d8d6edd565 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Jun 22 19:56:19.990609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 816/1397] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:20.219208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036465031", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed32d9a9-ebb9-465d-887b-d293660c0101"}], "security_groups": [{"name": "tempest-securitygroup--35550285"}], "key_name": "tempest-keypair-1155591304", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:20.322869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] validate_networks() for [('ed32d9a9-ebb9-465d-887b-d293660c0101', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 19:56:20.803560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 19:56:20.804257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 19:56:20.805030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 19:56:20.805680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 19:56:20.806383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 19:56:20.816504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:20.817070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:20.817868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:20.818296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:20.835246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 19:56:20.839727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Getting quotas for user 168c32f8fa8f4e07a8fc5418e9be4a13 and project d644d637dd9e45f2b46f27435fe6097d. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 19:56:20.852074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 19:56:20.854359 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 19:56:20.905772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0b986c66-010d-4afd-a036-dcce6d651475 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.691417 Jun 22 19:56:20.906443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 817/1398] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 19:56:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 19:56:20.916110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-522305b4-8628-4bdf-8e33-81d67d35c34f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:20.916721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-522305b4-8628-4bdf-8e33-81d67d35c34f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:20.967557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-522305b4-8628-4bdf-8e33-81d67d35c34f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:20.975674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-522305b4-8628-4bdf-8e33-81d67d35c34f tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1242 microversion: 2.1 time: 0.063264 Jun 22 19:56:20.976262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 818/1399] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:20 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:20.980982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:20.981582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:20.988651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:20.989088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:20.989852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:20.990300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:21.056556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:21.064247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b58b0d0f-37b9-482f-bad2-399258876f13 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.086949 Jun 22 19:56:21.064815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 819/1400] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:20 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:21.069397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:21.070394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:21.076188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:21.076635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:21.077397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:21.077821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:21.106518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0bec79af-de38-4ae8-ac09-7ec87d90efdc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 Jun 22 19:56:21.107313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 820/1401] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:21.993152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:21.994149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:22.004997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.006444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.007798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.008516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.075947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:22.085031 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-77476479-2927-4b7c-a721-231985c30b51 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1302 microversion: 2.1 time: 0.096476 Jun 22 19:56:22.085787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 821/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:21 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:22.096431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:22.097052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:22.106452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.106924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.107674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.108126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.168967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:22.176464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6c75352d-29cc-4fda-9a89-e98ae07d3064 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.089380 Jun 22 19:56:22.177068 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 822/1403] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:22 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:22.181584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:22.182491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:22.188502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.189233 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.189654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:22.190049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:22.227038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e75973f7-c9e5-4d9b-a225-daf4576584a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Jun 22 19:56:22.227621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 823/1404] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:23.103248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:23.103974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:23.110650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.111088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.111861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.112334 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.249275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:23.257221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7b75eb27-c5f4-440c-9248-cf3c68075eb9 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.157981 Jun 22 19:56:23.257807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 824/1405] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:23 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:23.272680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:23.273283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:23.280199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.280643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.281417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.281842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.346484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:23.354798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52abcc57-821a-4a2d-bcab-208521933408 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.085835 Jun 22 19:56:23.355458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 825/1406] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:23 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:23.360494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:23.361428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:23.370134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.370611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.371435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.371870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.406728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7f5c224d-78c8-4e2a-8d2b-bf5ec16577a3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049892 Jun 22 19:56:23.407348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 826/1407] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:23.438338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-c870e50e-2ea1-4a10-bbb6-b50f6d0210fc req-9b9186b3-710a-48c7-87d7-be75da3bae12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c37a123d-0a0a-4dc6-963b-319f220a7be5", "tag": "0422e19f-8a80-409f-8361-cd78795c9329"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:23.447120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c870e50e-2ea1-4a10-bbb6-b50f6d0210fc req-9b9186b3-710a-48c7-87d7-be75da3bae12 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:23.447989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c870e50e-2ea1-4a10-bbb6-b50f6d0210fc req-9b9186b3-710a-48c7-87d7-be75da3bae12 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:23.462981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-c870e50e-2ea1-4a10-bbb6-b50f6d0210fc req-9b9186b3-710a-48c7-87d7-be75da3bae12 service nova] Creating event network-changed:0422e19f-8a80-409f-8361-cd78795c9329 for instance c37a123d-0a0a-4dc6-963b-319f220a7be5 on hv-cinder-84721 Jun 22 19:56:23.473312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-c870e50e-2ea1-4a10-bbb6-b50f6d0210fc req-9b9186b3-710a-48c7-87d7-be75da3bae12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038521 Jun 22 19:56:23.474472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 827/1408] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:56:24.280188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:24.281364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:24.292258 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.293096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.293868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.294288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.429146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:24.437210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa6b2c72-e867-498f-b17b-34369af59451 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.164964 Jun 22 19:56:24.437782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 828/1409] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:24 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:24.442134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:24.442737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:24.445437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:24.448934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.449393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.450160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.450588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.518734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:24.526499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a7729feb-d8bd-4c2b-9d8c-b94058653313 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.087777 Jun 22 19:56:24.527102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 829/1410] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:24 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:24.531741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:24.532674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:24.538509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.538953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.539715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:24.540135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:24.569503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5c3311b3-db9e-4868-b532-44ef82189e69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Jun 22 19:56:24.570039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 830/1411] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:25.422750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=16 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:25.446855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:25.454909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:25.455557 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:25.462634 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.463105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.464033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.464529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.616638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:25.630858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-259dcba9-dbb8-4042-a107-d34c9a9bad14 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.179954 Jun 22 19:56:25.631792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 831/1412] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:25 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:25.638223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:25.638823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:25.644867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.645317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.646092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.646524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.714296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:25.722303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-211ec353-3383-4d35-8286-239f3c804881 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.089254 Jun 22 19:56:25.722888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 832/1413] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:25 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:25.727525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:25.728465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:25.734434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.734890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.735655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:25.736088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:25.765857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-97ac2f65-a5e4-4202-9e66-3aebc9a4b140 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Jun 22 19:56:25.766418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 833/1414] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:26.650904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:26.651541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:26.658478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.658933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.659817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.660164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.679521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:26.793304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:26.804584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dd33b720-948c-4924-bbcc-53ca87e77069 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.157411 Jun 22 19:56:26.805358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 834/1415] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:26 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:26.810066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:26.810662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:26.816624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.817066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.817817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.818240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.876612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:26.883880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-24c69657-5d8c-4921-9dac-2ac99dcbb1c4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.077578 Jun 22 19:56:26.884479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 835/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:26 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:26.889189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:26.890083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:26.895668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.896123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.896895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:26.897321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:26.926316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-79161bf3-ce36-4f60-baab-c5b96d1cf33a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040775 Jun 22 19:56:26.926791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 836/1417] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:27.822232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:27.822898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:27.829877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:27.830307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:27.831161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:27.831595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:27.960923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:27.969009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8f4ebc4c-c20d-4c20-a177-2badee246e46 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.151089 Jun 22 19:56:27.969575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 837/1418] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:27 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:27.973901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:27.974528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:27.980564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:27.981013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:27.981775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:27.982204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:28.046087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:28.057500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-924bc7a1-39f7-427a-8eba-e7d80f60508b tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.086680 Jun 22 19:56:28.058347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 838/1419] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:27 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:28.065222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:28.066542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:28.074839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:28.075279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:28.076039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:28.076504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:28.105720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-90157f65-6620-47fe-9696-8a09afe55b88 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Jun 22 19:56:28.106259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 839/1420] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:28.990299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:28.991430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:29.002267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.003013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.004307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.005061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.388434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:29.395969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3693c681-76c0-4f59-bff1-3fe61d5996d2 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.412303 Jun 22 19:56:29.396642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 840/1421] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:28 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:29.401073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:29.401672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:29.407837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.408326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.409118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.409552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.469558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:29.477472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f15e95cc-1d13-4ed2-8d3a-ae1520e4beb4 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.079820 Jun 22 19:56:29.478026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 841/1422] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:29 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:29.482685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:29.483663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:29.489502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.489953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.490714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.491144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.520253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-99801e8d-6d76-437c-a883-70a12d397c0b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Jun 22 19:56:29.520728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 842/1423] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:29.659018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-03453e59-8592-4a45-a334-ba2e6eab9a4a req-840abd27-1140-4a5e-bbe1-bb9b0459eea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c37a123d-0a0a-4dc6-963b-319f220a7be5", "name": "network-vif-plugged", "status": "completed", "tag": "0422e19f-8a80-409f-8361-cd78795c9329"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:29.667644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-03453e59-8592-4a45-a334-ba2e6eab9a4a req-840abd27-1140-4a5e-bbe1-bb9b0459eea8 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:29.668134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-03453e59-8592-4a45-a334-ba2e6eab9a4a req-840abd27-1140-4a5e-bbe1-bb9b0459eea8 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:29.679442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-03453e59-8592-4a45-a334-ba2e6eab9a4a req-840abd27-1140-4a5e-bbe1-bb9b0459eea8 service nova] Creating event network-vif-plugged:0422e19f-8a80-409f-8361-cd78795c9329 for instance c37a123d-0a0a-4dc6-963b-319f220a7be5 on hv-cinder-84721 Jun 22 19:56:29.684702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-03453e59-8592-4a45-a334-ba2e6eab9a4a req-840abd27-1140-4a5e-bbe1-bb9b0459eea8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162813 Jun 22 19:56:29.685280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 843/1424] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:30.414698 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:30.415377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:30.422623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.423069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.423831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.424305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.558349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:30.566007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c14b065f-69d4-406b-b234-338d08eb738a tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.156224 Jun 22 19:56:30.566569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 844/1425] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:30 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:30.570917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:30.571519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:30.577344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.577796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.578567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.578999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.639601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:30.647534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-85d2210f-4332-41d1-8ccc-230d4f783b33 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.080005 Jun 22 19:56:30.648073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 845/1426] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:30 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:30.652609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:30.653570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:30.659387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.659828 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.660615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:30.661042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:30.697032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-894fa8c8-c0b4-4ad5-8bc3-73a642990130 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046891 Jun 22 19:56:30.698549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 846/1427] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:31.585748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:31.586395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:31.589042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:31.589953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=12 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:31.597683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.598125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.598893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.599317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.734626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:31.742418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8fb68b3f-3d8c-4edb-9753-a7061de35497 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1366 microversion: 2.1 time: 0.163068 Jun 22 19:56:31.743017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 847/1428] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:31 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:31.747342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:31.747936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:31.754002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.754351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.755109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.755535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.821971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:31.829884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-53e9c7bc-a3b1-4d23-b6ea-69d5d04b8b66 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.085936 Jun 22 19:56:31.830463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 848/1429] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:31 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:31.835076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:31.836047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:31.842006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.842449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.843546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:31.843968 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:31.875685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bf49a57d-c6f8-438a-bfa0-a27e716f638b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Jun 22 19:56:31.876268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 849/1430] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:32.763941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:32.764928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:32.771758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:32.772234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:32.773000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:32.773430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:32.904133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:32.911888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2bf62212-8cce-496d-bb4a-431c1f3d10a1 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1555 microversion: 2.1 time: 0.154742 Jun 22 19:56:32.912564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 850/1431] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:32 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:32.916928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:32.917526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:32.923227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:32.923683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:32.924470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:32.924906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:32.984437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:32.987896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:32.993077 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0300602e-07be-4094-a35e-59db83dab5fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.079571 Jun 22 19:56:32.993641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 851/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:32 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:32.998294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:32.999242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:33.004932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:33.005382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:33.006136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:33.006564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:33.035443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-deee0d27-3eff-4cfd-8039-0cb2d4fb0b19 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Jun 22 19:56:33.035909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 852/1433] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:32 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:33.040225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:33.040724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:33.046543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:33.046952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:33.047726 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:33.048156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:33.124181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1dc62dad-b1b3-4cb7-9ecc-678c2434c477 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087158 Jun 22 19:56:33.124783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 853/1434] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 19:56:33 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:34.010824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:34.011463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:34.017915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:34.018368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:34.019131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:34.019562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:34.100220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:34.107131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e3b03210-97e1-4cec-bf25-aab79597fb7d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.100824 Jun 22 19:56:34.107737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 854/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:34 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:34.112456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:34.113399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:34.119199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:34.119724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:34.120455 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:34.120885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:34.150235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-df2fe17b-082f-4c88-8b80-49569108aa77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Jun 22 19:56:34.154105 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 855/1436] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:34.155441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-a9a062f0-28a0-40e5-a17c-ec790f45b099 req-8120413d-4c42-424b-9dd5-998db7241eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c37a123d-0a0a-4dc6-963b-319f220a7be5", "tag": "0422e19f-8a80-409f-8361-cd78795c9329"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 19:56:34.163467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-a9a062f0-28a0-40e5-a17c-ec790f45b099 req-8120413d-4c42-424b-9dd5-998db7241eee service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:34.163902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-a9a062f0-28a0-40e5-a17c-ec790f45b099 req-8120413d-4c42-424b-9dd5-998db7241eee service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:34.175328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-a9a062f0-28a0-40e5-a17c-ec790f45b099 req-8120413d-4c42-424b-9dd5-998db7241eee service nova] Creating event network-changed:0422e19f-8a80-409f-8361-cd78795c9329 for instance c37a123d-0a0a-4dc6-963b-319f220a7be5 on hv-cinder-84721 Jun 22 19:56:34.180336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-a9a062f0-28a0-40e5-a17c-ec790f45b099 req-8120413d-4c42-424b-9dd5-998db7241eee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028268 Jun 22 19:56:34.181120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 856/1437] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 19:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:35.125363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:35.126082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:35.132661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:35.133122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:35.133859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:35.134288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:35.201351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:35.209558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6aac5387-271d-477a-8531-c9d910e7aebf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.089228 Jun 22 19:56:35.210143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 857/1438] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:35 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:35.214932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:35.215851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:35.222401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:35.222840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:35.223618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:35.224071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:35.260309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-84627317-f23f-4ae4-9022-d289e63ebbc9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048975 Jun 22 19:56:35.260894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 858/1439] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:36.227042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:36.227774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:36.234500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:36.234954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:36.235717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:36.236215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:36.296195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:36.303868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cac23421-f91c-4729-aeca-0ef575c66960 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.080784 Jun 22 19:56:36.304504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 859/1440] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:36 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:36.309302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:36.310228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:36.316198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:36.316651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:36.317413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:36.317832 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:36.359797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-15d467c6-20e2-42f4-88a9-087d5fc228d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054278 Jun 22 19:56:36.360392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 860/1441] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:37.327802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:37.328561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:37.336132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:37.336641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:37.337497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:37.337978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:37.406743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:37.415017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fc730b62-0e93-4c5b-bc91-644bd2a36f9a tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.093557 Jun 22 19:56:37.415567 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 861/1442] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:37 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:37.420332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:37.421297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:37.427438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:37.427886 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:37.428697 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:37.429128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:37.458686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-64ed047c-484a-4fa9-ac58-e073be8c0b71 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 Jun 22 19:56:37.459236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 862/1443] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:38.436374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:38.437098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:38.443857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:38.444343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:38.445088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:38.445509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:38.508901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:38.516971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5f958059-9601-4b2d-bc88-d330e66ba246 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.087345 Jun 22 19:56:38.517549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 863/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:38 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:38.522117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:38.523033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:38.529485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:38.530012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:38.530846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:38.531340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:38.560515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bac06ec8-ecc2-4f14-ab01-01a7af7971ba tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jun 22 19:56:38.561041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 864/1445] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:39.538132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:39.539160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:39.548419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:39.548859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:39.549616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:39.550048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:39.611502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:39.619368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-10e7ea9e-f5ce-4e1e-b0fc-81e48be3e282 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.087877 Jun 22 19:56:39.619945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 865/1446] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:39 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:39.624424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:39.625356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:39.631284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:39.631735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:39.632534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:39.632972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:39.662582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dab0aced-e58e-40e7-b9f1-70ffd577a00f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Jun 22 19:56:39.663137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 866/1447] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:39 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:40.640639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:40.641659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:40.652658 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:40.653405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:40.654677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:40.655293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:40.727798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:40.739096 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a3281e4d-537a-4c45-a9b9-8b2817e9b746 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.104667 Jun 22 19:56:40.739850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 867/1448] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:40 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:40.744379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:40.745286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:40.751488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:40.751942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:40.752741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:40.753179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:40.782293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3fa23b32-6869-4009-ad4d-979275f5c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Jun 22 19:56:40.782845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 868/1449] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:41.760825 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:41.761866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:41.770040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:41.770499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:41.771277 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:41.771748 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:41.790736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:41.834026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:41.841708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b2fffa1e-92c6-401e-852e-08bb9c9331d3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.087691 Jun 22 19:56:41.842291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 869/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:41 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:41.847189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:41.848253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:41.854287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:41.854737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:41.855530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:41.855964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:41.885103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa30002d-b36c-4a50-845d-cbaa42153b66 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Jun 22 19:56:41.885648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 870/1451] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:42.863295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:42.864399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:42.874927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:42.875447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:42.876361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:42.876870 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:42.950176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:42.958116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fafda012-21e4-4059-9d1a-f5b63d18ccf0 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.101603 Jun 22 19:56:42.958692 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 871/1452] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:42 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:42.963153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:42.964055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:42.970449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:42.970900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:42.971664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:42.972094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:43.001128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-11d19a94-1488-467e-bb06-25a0adfcd198 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Jun 22 19:56:43.001672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 872/1453] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:43.979270 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:43.980336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:43.988498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:43.988941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:43.989727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:43.990155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:44.058519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:44.066624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0edb6633-0b97-4f32-9dbd-762495e34898 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.093771 Jun 22 19:56:44.067194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 873/1454] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:43 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:44.071777 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:44.072717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:44.078414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:44.078859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:44.079618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:44.080047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:44.108807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48ce211e-7e25-496f-8184-e260fc037c75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040538 Jun 22 19:56:44.109354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 874/1455] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:44 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:45.087207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:45.088262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:45.097000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:45.097449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:45.098207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:45.098641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:45.161145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:45.169081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7ceb7f00-5f06-4ecb-80e4-6194855be6cf tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.088336 Jun 22 19:56:45.169652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 875/1456] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:45 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:45.174173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:45.175076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:45.181288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:45.181728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:45.182486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:45.182917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:45.212781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c4ef4f4d-a0c5-4a24-bf5e-98511174b20d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jun 22 19:56:45.213331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 876/1457] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:46.189528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:46.190552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:46.202152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:46.202596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:46.203423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:46.203861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:46.269631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:46.277827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-94207d38-8989-403c-ba7d-7dfa566483e7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.094946 Jun 22 19:56:46.278402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 877/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:46 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:46.282909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:46.283822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:46.289815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:46.290273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:46.291044 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:46.291479 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:46.321542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6017ddd4-8b1a-4913-8e91-fd0625c5361a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Jun 22 19:56:46.322051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 878/1459] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:47.299138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:47.300276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:47.305594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:47.311366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:47.311804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:47.312599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:47.313022 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:47.377956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:47.389419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9431425c-6e33-450b-b518-ef3c0ba49870 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.096463 Jun 22 19:56:47.390184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 879/1460] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:47 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:47.394616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:47.395488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:47.401989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:47.402514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:47.403680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:47.404081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:47.432763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-28d21e10-5fdc-43e8-9f8d-b7e8c1031d12 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041626 Jun 22 19:56:47.433305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 880/1461] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:48.411029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:48.412167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:48.422150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:48.422594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:48.423341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:48.423768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:48.492342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:48.503272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a4b4d32c-7686-488e-a5e0-65f9c1ad745c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.098490 Jun 22 19:56:48.504005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 881/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:48 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:56:48.508556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:48.509490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:48.515755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:48.516232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:48.516980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:48.517409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:48.546201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0b9f1b0a-ac05-4d96-ac33-e89728ecf3bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Jun 22 19:56:48.546739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 882/1463] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:48 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:49.520849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:49.521484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:49.528727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:49.529179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:49.530047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:49.531100 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:49.605020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:49.612864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8b523a3b-3138-4727-9146-5fd38f901332 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.096302 Jun 22 19:56:49.613451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 883/1464] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:49 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:49.618049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:49.618967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:49.625171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:49.625620 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:49.626677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:49.627421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:49.656650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-84eca2dc-dc83-4ce0-97cb-2f31dafcaefd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Jun 22 19:56:49.657176 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 884/1465] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:50.634829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:50.635837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:50.644189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:50.644972 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:50.645738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:50.646171 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:50.706802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:50.715063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4850f61a-dd7d-449f-bc3f-a01170c063ce tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.087674 Jun 22 19:56:50.715639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 885/1466] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:50 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:50.720628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:50.721553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:50.727487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:50.727939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:50.728743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:50.729182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:50.732887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:50.759240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-90bbf2da-602e-40b6-870d-585516d5468a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Jun 22 19:56:50.759796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 886/1467] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:50 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:51.736754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:51.737850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:51.748640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:51.749386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:51.750716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:51.751216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:51.824695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:51.832539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ca4b5a10-0805-4e69-83ce-47bdf40a115e tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.102495 Jun 22 19:56:51.833115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 887/1468] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:51 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:51.837622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:51.838556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:51.844607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:51.845368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:51.846661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:51.847331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:51.880695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-148f8eaf-bfeb-4ee8-b961-b23165fa03f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Jun 22 19:56:51.881757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 888/1469] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:52.854490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:52.855553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:52.864329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:52.864780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:52.865531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:52.865952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:52.936790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:52.946118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-388dd618-7a64-4448-9244-d5b466ece121 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.098440 Jun 22 19:56:52.947066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 889/1470] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:52 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:52.952584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:52.953515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:52.961752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:52.962195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:52.962957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:52.963383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:52.994000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48b6af20-37b7-41d2-81e0-41d676d2cf5e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Jun 22 19:56:52.994529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 890/1471] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:52 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:53.969140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:53.970671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:53.977647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:53.978093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:53.978845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:53.979302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:54.045905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:54.058339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-20068b24-9bf0-4372-b71b-f11339a936e5 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.095915 Jun 22 19:56:54.059198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 891/1472] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:53 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:54.063682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:54.064674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:54.070797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:54.071251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:54.072052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:54.072484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:54.103203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52c634dc-7923-41d5-b8f8-ca51aa542764 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Jun 22 19:56:54.103763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 892/1473] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:55.077640 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:55.078468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:55.085802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:55.086248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:55.086998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:55.087426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:55.153988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:55.161921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4c5a1f97-8f0f-4b5d-b503-9ef320cd40e1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.088880 Jun 22 19:56:55.162494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 893/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:55 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:55.166955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:55.167857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:55.174012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:55.174467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:55.175265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:55.175703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:55.204080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4067eae4-e838-4093-a112-15b2b5cc2218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040614 Jun 22 19:56:55.204651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 894/1475] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:56.182271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:56.182949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:56.190114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:56.190561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:56.191326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:56.191752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:56.263396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:56.276014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-639641bb-6bab-45fa-ad17-8f27bcd14434 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.099489 Jun 22 19:56:56.276857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 895/1476] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:56 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:56.283583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:56.284537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:56.290470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:56.290921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:56.291768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:56.292134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:56.321522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-341f80d3-bf6a-4d6e-8e96-f7b38b94bc36 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jun 22 19:56:56.322081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 896/1477] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:56 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:57.298347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:57.299087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:57.306830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:57.307325 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:57.308159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:57.308684 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:57.378676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:57.386165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4a0a3a53-a2ee-40d2-899a-1768ed6bf7f7 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.092493 Jun 22 19:56:57.386717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 897/1478] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:57 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:57.391503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:57.392447 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:57.398398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:57.398876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:57.399615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:57.400047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:57.430540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-609865ba-cba8-4b2b-9731-d143a9aab41d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Jun 22 19:56:57.431079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 898/1479] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:58.403128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:58.403899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:58.410732 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:58.411170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:58.411920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:58.412375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:58.482500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:58.490318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a2cd9f8c-a355-49e3-80c9-0fbaa8fbbfca tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.091142 Jun 22 19:56:58.490867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 899/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:58 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:58.495309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:58.496230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:58.501857 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:58.502294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:58.503094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:58.503516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:58.531864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7db56335-a047-4efc-ac83-0c907e5950e7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040020 Jun 22 19:56:58.532390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 900/1481] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:58 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:56:59.507918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:59.508571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:59.515537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:59.515991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:59.516788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:59.517217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:59.578213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:56:59.586274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4b5eddd9-e7a9-4799-a794-35a7b3953057 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.082433 Jun 22 19:56:59.586849 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 901/1482] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:56:59 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:56:59.591604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:56:59.592585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:56:59.599090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:59.599550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:59.600357 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:56:59.600791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:56:59.626217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:56:59.631106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d677142c-0ec6-4f86-a2a0-3f97146f78a0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Jun 22 19:56:59.631685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 902/1483] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:56:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:00.607954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:00.608985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:00.619752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:00.620549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:00.621791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:00.622492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:00.687660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:00.695827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2a3fdb10-16e9-490f-aa0e-d127e574e6ef tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.094886 Jun 22 19:57:00.696430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 903/1484] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:00 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:00.701201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:00.702120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:00.708002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:00.708489 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:00.709284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:00.709720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:00.739169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-481382ac-837b-4292-8f85-faba1bf895ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Jun 22 19:57:00.739645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 904/1485] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:01.716064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:01.717071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:01.727734 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:01.728341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:01.729522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:01.730169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:01.794147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:01.802106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5648f79c-88db-4f91-bc3a-3d5de07354c6 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.092112 Jun 22 19:57:01.802687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 905/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:01 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:01.807151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:01.808094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:01.813941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:01.814392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:01.815162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:01.815586 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:01.845274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9570f490-6c6b-4e20-a517-5068eebf887a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Jun 22 19:57:01.845837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 906/1487] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:02.821566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:02.822326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:02.829826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:02.830323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:02.831175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:02.831644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:02.901483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:02.909568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cef6b3a5-f571-4d64-83a6-836846d0e836 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.092856 Jun 22 19:57:02.910154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 907/1488] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:02 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:02.914768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:02.915679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:02.921657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:02.922106 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:02.922896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:02.923297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:02.953879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ed93280f-74cd-4685-91ed-77c80f5c25f4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Jun 22 19:57:02.954420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 908/1489] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:02 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:03.930180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:03.930973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:03.939393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:03.939949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:03.940933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:03.941463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:04.007720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:04.020495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-96ca0f45-4bf2-4f6e-9d00-dcfd48b5b4c8 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.095379 Jun 22 19:57:04.020995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 909/1490] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:03 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:04.025605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:04.026522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:04.032418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:04.032865 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:04.033626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:04.034053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:04.063708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f00ce949-728f-42bb-a635-329a851843cc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Jun 22 19:57:04.064267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 910/1491] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:05.041654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:05.042762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:05.052963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:05.053720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:05.054987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:05.055701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:05.123819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:05.131678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-50f94495-54fa-496a-8c2b-178988db4496 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.096781 Jun 22 19:57:05.132279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 911/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:05 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:57:05.136764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:05.137650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:05.143304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:05.143757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:05.144544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:05.145013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:05.176507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9b3d0907-79f4-4afa-8c34-109963e82dfa tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Jun 22 19:57:05.177086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 912/1493] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:06.150311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:06.151007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:06.158188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:06.158659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:06.159488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:06.159945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:06.227020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:06.235143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fda49fce-a477-45c3-8670-2d9415ceb564 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.089141 Jun 22 19:57:06.235687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 913/1494] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:06 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 19:57:06.240746 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:06.241669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:06.247663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:06.248123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:06.248951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:06.249389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:06.279167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4f5e10eb-8240-4f9c-84e0-53cca9dc27b0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Jun 22 19:57:06.279724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 914/1495] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:07.252353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:07.253021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:07.260051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:07.260536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:07.261288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:07.261721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:07.332302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:07.340492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6a72fe24-28d5-49be-8168-d5760fe297fb tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.092104 Jun 22 19:57:07.341057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 915/1496] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:07 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:07.345980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:07.346888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:07.352944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:07.353396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:07.354158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:07.354601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:07.385395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-28d9264e-84ae-4ae0-a709-5bf3e41dced3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Jun 22 19:57:07.385932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 916/1497] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:08.361342 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:08.362453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:08.370430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:08.370882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:08.371657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:08.372091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:08.432982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:08.441032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fa183488-111d-4810-b346-a9ef0c7c31cc tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.086355 Jun 22 19:57:08.441615 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 917/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:08 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:08.446279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:08.447184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:08.454838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:08.455420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:08.456693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:08.457272 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:08.487839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9b6bbb99-49c0-48ae-8e67-245af2b57a07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Jun 22 19:57:08.488428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 918/1499] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:08 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:09.458278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:09.459046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:09.465990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:09.466445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:09.467231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:09.467664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:09.486340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:57:09.542806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:09.550850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cc35569e-bdd2-4c50-a0f8-c10d1b4ba207 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.096588 Jun 22 19:57:09.551424 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 919/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:09 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:09.556215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:09.557276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:09.563493 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:09.563944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:09.564752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:09.565180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:09.595068 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-90849930-bdcc-4225-ad70-814eb28263c4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042620 Jun 22 19:57:09.595613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 920/1501] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:10.572276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:10.573200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:10.584441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:10.585195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:10.586456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:10.587177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:10.661725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:10.669928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-615253ea-cce0-42c0-afbf-94e958c2782d tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.104429 Jun 22 19:57:10.670481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 921/1502] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:10 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:10.675134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:10.676043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:10.682764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:10.683216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:10.683981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:10.684446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:10.720092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bf3e5d7e-8352-427f-9121-c10e488a3ac3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048560 Jun 22 19:57:10.720722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 922/1503] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:11.687068 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:11.687785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:11.694454 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:11.694921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:11.695680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:11.696133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:11.767791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:11.777377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b8ccc07f-b4b1-4402-8c88-c26d6cd0bed1 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.094172 Jun 22 19:57:11.777919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 923/1504] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:11 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:11.782472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:11.783382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:11.789690 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:11.790156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:11.790943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:11.791438 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:11.821927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3a65faac-129f-4db8-86c9-d0f56a34fc58 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Jun 22 19:57:11.822480 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 924/1505] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:12.922785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:12.923429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:12.929761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:12.930208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:12.930957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:12.931380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:12.992631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:57:13.000459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-567014aa-cacc-4f9e-9fba-4540ff5f8561 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.208559 Jun 22 19:57:13.001029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 925/1506] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:57:12 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:57:13.005851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:13.006846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:13.013143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:13.013610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:13.014370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:13.014806 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:13.043647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-372f4d64-49b1-4a0a-b016-7d417aa190b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Jun 22 19:57:13.044221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 926/1507] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:57:13 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:57:13.086194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:57:13.086898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:57:13.097066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:13.097816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:13.099082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:57:13.099798 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:57:23.092898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=96 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:57:23.124867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=48 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:14.719470 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:58:14.808308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:58:14.910780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 19:58:14.913045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:58:14.914679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:58:14.915692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:58:14.917113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.918304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:58:14.919532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) Jun 22 19:58:14.920933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.922215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c966f75-659e-44a4-8149-e7b9386deae4) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:58:14.922215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e1ae00ab-2613-488a-a943-a13ce6ccc6d6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 119.501393 Jun 22 19:58:14.922215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 582/1508] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:56:15 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 119504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:58:14.923344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:14.923939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:14.931144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:14.931590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:14.932367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:14.932803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:14.944195 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 19:58:14.946457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 19:58:14.947743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:58:14.949047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 19:58:14.950072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.951218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:58:14.953688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) Jun 22 19:58:14.956163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 19:58:14.958418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec1a7a2-b098-48e4-abac-71dca9ac5e4e) {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 19:58:14.958418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7ea153bd-9b78-474f-a7bf-8651c639b5aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 61.866501 Jun 22 19:58:14.958418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 927/1509] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:57:13 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 61868 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 19:58:14.958418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:14.960353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:14.966545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:14.967484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:14.968294 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:14.969111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.000153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:58:15.001402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8ddd37ab-a9e4-4236-a821-58af02df42a2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050966 Jun 22 19:58:15.002196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 928/1510] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:15.007075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:15.007565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:15.009799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e7014443-2792-42f2-8f4a-d010902209e3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.090896 Jun 22 19:58:15.010683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 583/1511] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:58:14 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:58:15.013588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.014041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.014807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.015242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.016095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:15.016769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:15.024066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.025042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.026391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.026913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.038938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cbe06aab-65c6-40f0-bffc-4247efe9da62 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5/ips" status: 200 len: 149 microversion: 2.1 time: 0.035314 Jun 22 19:58:15.040368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 929/1512] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 19:58:15 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:15.045253 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:15.046413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] [instance: bd94079a-3077-4049-b0a1-f51dfdb0b821] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:15.053644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.053644 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.054404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.055252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.138461 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b20561384a4329819a078e44cb82bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533866da89004b95bb450a4dec134531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 19:58:15.146048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b0bd9524-e135-4b43-a6a4-669161d80af3 tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821" status: 200 len: 1212 microversion: 2.1 time: 0.104465 Jun 22 19:58:15.146618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 930/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 19:58:15 2022] GET /compute/v2.1/servers/bd94079a-3077-4049-b0a1-f51dfdb0b821 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 19:58:15.152341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:15.153464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:15.159812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.160296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.161240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:15.161835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:15.192956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9bd5f065-ca06-46fe-bbde-0b2489dbb3dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Jun 22 19:58:15.193823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 931/1514] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:15.330848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-45402cff-8862-4ffd-b643-2e9be503d22c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] Calling method '.version_select at 0x7fdc1e4621f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:15.364398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-45402cff-8862-4ffd-b643-2e9be503d22c tempest-TestShelveInstance-846627074 tempest-TestShelveInstance-846627074-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1681006282" status: 202 len: 0 microversion: 2.1 time: 0.038636 Jun 22 19:58:15.374816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 19:58:15.376420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 932/1515] 10.222.0.26 () {58 vars in 1253 bytes} [Wed Jun 22 19:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1681006282 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 19:58:16.205320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:16.206224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:16.213470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:16.213904 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:16.214686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:16.215110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:16.244147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-89b45061-1b1b-4f39-a03d-469fe131c652 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Jun 22 19:58:16.244690 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 933/1516] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:17.255450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:17.256417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:17.263142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:17.263613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:17.264643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:17.266156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:17.298208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5e5648ae-6439-4672-94da-817d97bacde7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Jun 22 19:58:17.298884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 934/1517] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:18.310257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:18.312037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:18.318785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:18.319088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:18.319868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:18.320497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:18.357255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-53bd9e1b-5693-4c4f-85ec-c82b452edfc8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051202 Jun 22 19:58:18.357842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 935/1518] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:58:19.369187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:19.370040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:19.376884 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:19.377370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:19.378139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:19.378575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:19.407582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6c52e44d-39ee-4d3d-ad17-de7c1fca9d09 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 Jun 22 19:58:19.408211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 936/1519] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:20.419696 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:20.420648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:20.427367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:20.427819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:20.428608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:20.429037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:20.458770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f4be3a33-928d-47a3-bcd6-39ff0ab4a5df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 Jun 22 19:58:20.459318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 937/1520] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:21.472317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:21.472317 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:21.479226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:21.479880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:21.480882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:21.481313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:21.514925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-956eb81d-504c-4e4e-94fc-c36787d558fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Jun 22 19:58:21.515631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 938/1521] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:58:22.526769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:22.527822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:22.534540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:22.534983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:22.535733 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:22.536191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:22.565185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0567549b-54cc-48b7-b1ae-658db0f61452 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 Jun 22 19:58:22.565976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 939/1522] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:23.581136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:23.582617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:23.593973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:23.594727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:23.595989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:23.596791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:23.633235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b1a1ce9f-556e-417b-9a8d-28cbea9fcd77 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058719 Jun 22 19:58:23.633778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 940/1523] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:24.649933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:24.651395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:24.662300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:24.663056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:24.664364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:24.665101 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:24.701387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9046f351-f063-4fb3-93ec-31fae2e115b5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058426 Jun 22 19:58:24.701929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 941/1524] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:25.023805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:25.388528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=18 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:25.718386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:25.719894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:25.729235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:25.729681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:25.730446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:25.730898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:25.759508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d13131a9-a512-46ab-88ab-b53cb8ae8069 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048486 Jun 22 19:58:25.760049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 942/1525] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:26.771634 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:26.772488 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:26.779459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:26.779898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:26.780686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:26.781107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:26.810210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bc5035af-d55b-4f2e-8074-26ee9d5657e6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Jun 22 19:58:26.810756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 943/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:27.826341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:27.827926 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:27.837803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:27.838252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:27.839016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:27.839446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:27.868769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3814c649-1a96-4d4a-9a41-375d70ec6923 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Jun 22 19:58:27.869345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 944/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:27 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:28.883169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:28.883997 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:28.890831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:28.891281 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:28.892042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:28.892508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:28.896300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:28.922851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fdddf60c-b218-4647-bf5d-28e80e424b72 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Jun 22 19:58:28.923420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 945/1528] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:29.937519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:29.938905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:29.949240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:29.949932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:29.951107 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:29.951786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:29.984659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-31b16ad1-ecf7-4fe0-88eb-7e0c71f1c36b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053407 Jun 22 19:58:29.985139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 946/1529] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:30.998981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:30.999985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:31.009038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:31.009478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:31.010229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:31.010659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:31.039759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2c43ea2f-11b6-49ab-802e-b944b73fc88d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046919 Jun 22 19:58:31.040346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 947/1530] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:32.057305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:32.058766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:32.069739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:32.070574 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:32.072134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:32.072936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:32.107847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-01b38bb1-0872-43af-90ce-1025abd722da tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057368 Jun 22 19:58:32.108450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 948/1531] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:32 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:33.123740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:33.125314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:33.135127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:33.135572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:33.136363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:33.136781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:33.166018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c7a2c387-f1a0-4878-ac2c-dd7a0e1e82d8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049198 Jun 22 19:58:33.166814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 949/1532] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:33 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:34.184042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:34.185444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:34.195643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:34.196128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:34.196900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:34.197331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:34.227986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a77b598e-7da3-4ec9-9a1d-7de32800aba5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051118 Jun 22 19:58:34.228579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 950/1533] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:35.243522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:35.244784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:35.253803 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:35.254411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:35.255428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:35.255984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:35.289313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-51acbd28-89e7-41f6-8ea1-a6be0a1c3add tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052132 Jun 22 19:58:35.289869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 951/1534] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:36.300623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:36.301545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:36.308583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:36.309055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:36.309819 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:36.310257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:36.339747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-02b3856e-8cf3-4f97-82b5-efc4f2c6f634 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Jun 22 19:58:36.340345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 952/1535] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:37.355196 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:37.356423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:37.366862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:37.367334 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:37.368144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:37.368610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:37.400663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3cb1ff5b-5612-492d-938f-a72e9424bf52 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052306 Jun 22 19:58:37.401208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 953/1536] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:38.416778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:38.417817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:38.425423 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:38.425933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:38.426779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:38.427260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:38.458220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7375c7a9-7eae-4f7e-ac20-dafc3e76099b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Jun 22 19:58:38.458763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 954/1537] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:39.474890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:39.476412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:39.488175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:39.488953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:39.490280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:39.491060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:39.521393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6866ddd5-ba8f-43d8-b4ea-c0b9ea17256d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053326 Jun 22 19:58:39.521947 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 955/1538] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:39 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:58:40.538064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:40.539556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:40.550441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:40.551288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:40.552791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:40.553536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:40.585847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-63d077e7-ae20-4fbe-8e9e-f9bb7fed48f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055040 Jun 22 19:58:40.586473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 956/1539] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:41.598113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:41.599032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:41.605814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:41.606259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:41.607020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:41.607451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:41.637348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8a078c8a-c0b4-4973-a170-fa06746b4627 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Jun 22 19:58:41.638051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 957/1540] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:58:42.653743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:42.655112 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:42.666118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:42.666869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:42.668145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:42.668919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:42.702298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6077133e-9f44-4104-9fe8-baa53ced6d9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055672 Jun 22 19:58:42.702871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 958/1541] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:43.714514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:43.715422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:43.718164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:43.723772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:43.724236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:43.724988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:43.725411 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:43.755128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-91a4e6e6-2f09-461c-ab7a-6eb5863cbdd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Jun 22 19:58:43.755596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 959/1542] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:43 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:44.771856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:44.773166 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:44.780702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:44.781199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:44.782114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:44.782592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:44.813246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d91e1174-c949-4244-aeb0-2e6cd33fc2ac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048374 Jun 22 19:58:44.813810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 960/1543] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:44 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:45.829624 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:45.831024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:45.839623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:45.840072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:45.840944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:45.841372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:45.866387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:58:45.871324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e41252e8-4d22-43b2-bd92-1511332cbfe2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Jun 22 19:58:45.871875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 961/1544] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:46.788151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:58:46.788966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:58:46.887353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:46.888899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:46.900048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:46.900853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:46.902111 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:46.902829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:46.935963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-04464df8-f327-4990-b1a5-9dbb40e5a579 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055501 Jun 22 19:58:46.936471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 962/1545] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:47.951685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:47.953223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:47.962749 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:47.963202 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:47.963946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:47.964418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:47.997871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1529e81d-d979-4d04-b718-0ee66c0d7874 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052549 Jun 22 19:58:47.998678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 963/1546] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:49.015914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:49.017419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:49.028431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:49.029165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:49.030422 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:49.031137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:49.063566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d08cec70-dba7-43c3-ae7f-d497b3fc7614 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054266 Jun 22 19:58:49.064033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 964/1547] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:50.080000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:50.081606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:50.090278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:50.090664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:50.091433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:50.092221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:50.123433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-24d6fe57-dfe8-4dea-b7ec-9b199ce26bee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050665 Jun 22 19:58:50.124146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 965/1548] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:50 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:51.139226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:51.140747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:51.152321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:51.153577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:51.155345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:51.156651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:51.190830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-08f358cb-b08a-479c-9571-95b55c5b9af4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058306 Jun 22 19:58:51.191373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 966/1549] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:52.206919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:52.208535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:52.216070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:52.216593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:52.217708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:52.218164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:52.247949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-02caeff9-c5d2-4df6-a5d5-a97c7e9fb9a4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047814 Jun 22 19:58:52.248504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 967/1550] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:52 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:53.260137 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:53.261123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:53.268757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:53.269284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:53.270127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:53.270606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:53.299995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bde3da6e-fb93-4401-b6d7-ee15b3c19578 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 Jun 22 19:58:53.300589 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 968/1551] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:53 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:54.315502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:54.317041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:54.324969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:54.325420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:54.326190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:54.326621 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:54.357043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5826b17b-e676-43e9-9b08-cba52f6adfe1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Jun 22 19:58:54.357602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 969/1552] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:54.741504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:58:54.742334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:58:55.374634 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:55.375809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:55.385594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:55.386177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:55.387330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:55.387887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:55.420168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-27fb7416-df31-4561-96b6-f4a780c07395 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052066 Jun 22 19:58:55.420755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 970/1553] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:55.945583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:58:55.945882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 19:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:58:56.431146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:56.431984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:56.438787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:56.439230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:56.439988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:56.440453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:56.470576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-162b2e7a-3943-47fb-bedb-69c89479d7ff tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Jun 22 19:58:56.471237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 971/1554] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:56 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:58:57.487383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:57.488982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:57.496699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:57.497145 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:57.497905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:57.498338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:57.527221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3fa15d0d-abe9-4d4c-933f-3070b0c42b46 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Jun 22 19:58:57.527770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 972/1555] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:58.544905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:58.546345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:58.556095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:58.556569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:58.557329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:58.557879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:58.589709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-31bdfd42-4c0f-4fb9-b927-ec22d64564d4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052913 Jun 22 19:58:58.590263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 973/1556] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:58 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:58:59.607535 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:58:59.609062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:58:59.620152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:59.620934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:59.622234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:58:59.623006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:58:59.655038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e7579460-735c-43ca-9753-cd426c384efe tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054440 Jun 22 19:58:59.655576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 974/1557] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:58:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:00.666855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:00.667856 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:00.674906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:00.675345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:00.676127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:00.676566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:00.705855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-24751984-3e67-4e9d-95c5-817c62094d0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jun 22 19:59:00.706379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 975/1558] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:01.722356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:01.723769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:01.731490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:01.731937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:01.732737 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:01.733170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:01.764500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0796d430-a791-417c-ad6c-b466c42e89b2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049337 Jun 22 19:59:01.765064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 976/1559] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:02.780516 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:02.781871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:02.792469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:02.793227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:02.794457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:02.795164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:02.827661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fd90db2b-83ca-4f02-b042-e7bd37d8f4a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053888 Jun 22 19:59:02.828235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 977/1560] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:02 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:59:03.844144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:03.845932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:03.854300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:03.854752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:03.855526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:03.855959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:03.872628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:59:03.886179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c21bcf7a-276c-4a9a-b9e0-9c9e2e2e331c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049311 Jun 22 19:59:03.886750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 978/1561] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:03 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:04.901614 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:04.902956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:04.913387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:04.913830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:04.914595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:04.915024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:04.943666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52486474-6912-49ad-a5ec-fd9031d2ee69 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048873 Jun 22 19:59:04.944400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 979/1562] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:05.960132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:05.961205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:05.969167 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:05.969654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:05.970503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:05.970981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:06.002878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fdd61dc1-4463-4375-9ad4-efb00ebd5fda tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049546 Jun 22 19:59:06.003444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 980/1563] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:07.015206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:07.016201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:07.022984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:07.023407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:07.024218 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:07.024642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:07.053664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-878d36c3-b541-492c-859c-f7336e12555d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 Jun 22 19:59:07.054206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 981/1564] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:08.069372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:08.071221 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:08.082891 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:08.083751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:08.084896 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:08.085330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:08.115126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b82f2f57-8a73-4945-94e9-0ffa8bb6b5cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052861 Jun 22 19:59:08.115651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 982/1565] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:08 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 19:59:09.131346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:09.132340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:09.141242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:09.141888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:09.143082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:09.143720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:09.179907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c6deb6e2-c129-44b4-8a76-7f85d0e77669 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055587 Jun 22 19:59:09.180492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 983/1566] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:10.195135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:10.196708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:10.207528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:10.208374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:10.209607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:10.210036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:10.239283 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ff54fe31-6c98-480a-a1c4-99917cd2efde tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Jun 22 19:59:10.240262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 984/1567] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:10.359765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:59:10.360464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 19:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 19:59:11.251739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:11.252707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:11.259599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:11.260038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:11.260822 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:11.261248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:11.290763 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-142a2e07-9cd6-4713-acde-00a19165f034 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Jun 22 19:59:11.291394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 985/1568] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:12.302714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:12.303628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:12.310473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:12.310920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:12.311671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:12.312125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:12.341162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-06d5b547-a836-456b-b242-65fb4926494b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Jun 22 19:59:12.342037 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 986/1569] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 19:59:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 19:59:13.208880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 19:59:13.209497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 19:59:13.215874 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:13.216361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:13.217437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 19:59:13.217868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 19:59:23.213681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=57 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 19:59:23.235936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=54 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:00:15.579101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:00:15.582217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:00:15.583645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:00:15.584434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:00:15.585542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:00:15.586707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:00:15.587801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) Jun 22 20:00:15.591284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:00:15.593831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6993b09d-4c1e-42ae-86c9-efe2791220f1) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:00:15.593831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-43333ec7-ce2a-4661-bddb-d001f8dda437 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 120.571871 Jun 22 20:00:15.593831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 584/1570] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:58:15 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 120573 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:00:15.593831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:00:15.594382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:00:15.601593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:00:15.601593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:00:15.602358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:00:15.603127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:00:15.633722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7de4938d-5990-4bef-8000-321b62b3f0d1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Jun 22 20:00:15.634307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 585/1571] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:00:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:00:15.638890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:00:15.639401 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:00:15.645246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:00:15.645922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:00:15.646901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:00:15.647404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:00:15.720190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:00:24.375130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:00:24.376352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 20:00:25.642662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:00:25.666529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=10 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:00:25.731768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:02:06.802121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:02:06.803043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 20:02:14.754733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:02:14.755440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 (ip 10.222.0.26) !!! Jun 22 20:02:15.808687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:02:15.824604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:02:15.827368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:02:15.828809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:02:15.829501 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:02:15.831000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:15.832663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:15.833701 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) Jun 22 20:02:15.834840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:15.836890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d32ac71-0d76-49d0-9c80-b00a0f2b29c3) {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:15.836890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3464869c-e6ea-4daa-9e50-9ec85350f8ea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 182.628302 Jun 22 20:02:15.836890 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 987/1572] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 19:59:13 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 182630 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:15.958936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:02:15.959115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments (ip 10.222.0.26) !!! Jun 22 20:02:16.129996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.131710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.138015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.138560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.139482 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.139980 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.169067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13215deb-ad5b-4cc1-8703-65d1097f6d8b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.333977 Jun 22 20:02:16.169708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 988/1573] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:02:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:02:16.175801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.175801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.181172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.181619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.182375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.182801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.195892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 HTTP/1.1 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:02:16.197462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.199164 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '33f1a7b5-b17d-4ab9-b756-dd1d5e726077'} Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:16.200129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.201612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.203055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:16.203055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f955f72a-6071-4a41-b9cb-a63b67478916 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 404 len: 111 microversion: 2.20 time: 0.027819 Jun 22 20:02:16.203055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 989/1574] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jun 22 20:02:16 2022] DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:16.203744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.204731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.210467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.210911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.211670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.212229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.241213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-02c37663-56e2-4c7c-b9c6-2c632d66ba08 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Jun 22 20:02:16.241765 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 990/1575] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:02:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:02:16.246537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.247033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.250363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.252617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 HTTP/1.1 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:02:16.252759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:02:16.254296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'server_id': '42be957b-1878-4d34-8da2-b0c98a90fd55', 'id': 'f7f033bd-d8ac-4f5f-a555-01766eea0327'} Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:02:16.255209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:02:16.256721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.258116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.259404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) Jun 22 20:02:16.260765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.262047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.262153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19639d5a-f8ad-4c9b-9f92-ac0110255c93) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:16.262263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.262359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-35bc495d-9c66-44c7-84ae-ccc7835dae06 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327" status: 400 len: 269 microversion: 2.1 time: 120.618793 Jun 22 20:02:16.262462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.262557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 586/1576] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:00:15 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55/os-volume_attachments/f7f033bd-d8ac-4f5f-a555-01766eea0327 => generated 269 bytes in 120620 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:16.262557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.262557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.268678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.269123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.269884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.270308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.274408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 HTTP/1.1 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:02:16.276048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.277509 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '33f1a7b5-b17d-4ab9-b756-dd1d5e726077'} Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:16.278338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.279596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.281663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:16.281663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eec6de9a-ff62-407c-86f2-6daee0eb2d76 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 404 len: 111 microversion: 2.20 time: 0.034814 Jun 22 20:02:16.281663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 991/1577] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jun 22 20:02:16 2022] DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:16.283523 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.284020 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.290069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.290548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.291308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.291739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.300714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-be0d4181-0e8d-4572-b660-109ea7751932 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Jun 22 20:02:16.301388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 587/1578] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:02:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:02:16.309108 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 HTTP/1.1 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:02:16.310689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.312400 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '33f1a7b5-b17d-4ab9-b756-dd1d5e726077'} Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:16.313385 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.314957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.316605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:16.316605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d59f33e5-b57d-4c7b-92f7-1ac276d0a8b6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 404 len: 111 microversion: 2.20 time: 0.032895 Jun 22 20:02:16.316605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 992/1579] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jun 22 20:02:16 2022] DELETE /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:16.320611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:02:16.321214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] [instance: 33f1a7b5-b17d-4ab9-b756-dd1d5e726077] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:16.327132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.327566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.328334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:16.328759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:16.341965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] HTTP exception thrown: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Request method failure captured: Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 HTTP/1.1 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_DdcUOnhFLq6sSzdRZORF1thq98MBWCNLj2JfqPOejqwELxdbuJStUW018cUpW_UjCQ3IrQ9JW4NZnrG23QmA6jcgTjzBjaKaehLxSL8tkDkPIhD1I8MJh309eStQtOP8h8klALkamrwXZ_3mnNAqMb5PKFV_kIKS-RxU5fPFAkzc Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:02:16.343499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b90964fa17494782b2a49ff54cfede88", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b90964fa17494782b2a49ff54cfede88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: b90964fa17494782b2a49ff54cfede88 Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704665904 Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 20ef6f7c907b407b9d76bc814749d403 Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704665904-project Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.344969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '33f1a7b5-b17d-4ab9-b756-dd1d5e726077'} Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:02:16.346089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. Jun 22 20:02:16.347735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:02:16.349199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] Returning 404 to user: Instance 33f1a7b5-b17d-4ab9-b756-dd1d5e726077 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:02:16.349199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-085cb918-a516-4ca3-8786-5acd2f8753f6 tempest-AttachVolumeShelveTestJSON-704665904 tempest-AttachVolumeShelveTestJSON-704665904-project] 10.222.0.26 "GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077" status: 404 len: 111 microversion: 2.20 time: 0.028066 Jun 22 20:02:16.349199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 588/1580] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jun 22 20:02:16 2022] GET /compute/v2.1/servers/33f1a7b5-b17d-4ab9-b756-dd1d5e726077 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 20:02:17.312780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:02:17.313718 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:02:17.322209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:17.322998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:17.323817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:02:17.324331 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:02:17.354483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 20:02:18.363366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [0e6b802c-241a-4e74-8861-dd3a25404ba2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59012. Jun 22 20:02:18.435816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-74ded65a-1846-486f-90a5-0e77e07d8a5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action" status: 200 len: 76877 microversion: 2.1 time: 1.126880 Jun 22 20:02:18.443966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 993/1581] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 20:02:17 2022] POST /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018/action => generated 76877 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 20:02:30.369752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:02:30.370255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:02:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:03:44.387473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:03:44.388614 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:04:14.372047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 20:04:14.372617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:14.373275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=12 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:14.377043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:14.377529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:14.384404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:14.384850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:14.385603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:14.386030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:14.410846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:04:14.489249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d05ff1c7-7878-4855-ab41-b7c24f73a7e0 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 204 len: 0 microversion: 2.1 time: 0.118929 Jun 22 20:04:14.489888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 589/1582] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:04:14 2022] DELETE /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:04:14.497271 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=12 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:14.498039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=22 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:14.502801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:14.503496 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:14.511558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:14.512002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:14.512860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:14.513292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:14.660256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:14.668082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dfb881cf-d9df-4de1-bce7-9d1788f3ee2a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1508 microversion: 2.1 time: 0.173035 Jun 22 20:04:14.668668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 994/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:14 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:04:15.687862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:15.688760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:15.697869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:15.698382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:15.699535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:15.700169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:15.706663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 60456. Jun 22 20:04:15.905963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:15.906534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:15.912999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:15.913464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:15.914229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:15.914664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:15.921667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:15.929509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9f31cc6c-628a-459c-ae08-db94cd04bd8c tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1508 microversion: 2.1 time: 0.247912 Jun 22 20:04:15.930744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 590/1584] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:15 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:15.940927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:04:16.020848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fcd6bfa4-3624-4ddf-a3ba-16a0aa7db8fc tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 204 len: 0 microversion: 2.1 time: 0.118213 Jun 22 20:04:16.021944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 995/1585] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:04:15 2022] DELETE /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 20:04:16.030707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:16.031393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:16.039890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.040428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.041262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.041742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.244381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:16.253500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a451a1b9-1c7e-4798-a711-600983087946 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1680 microversion: 2.1 time: 0.226711 Jun 22 20:04:16.254149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 591/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:16 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:16.391981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-0c57edfb-c156-4040-8c63-c2ffa5c17b41 req-eb01b6f5-2404-4c5a-bcb5-bd263aed7dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4083c205-6284-4602-ac2f-c515a2c55045", "name": "network-vif-deleted", "tag": "8ba90739-57c2-4418-bf14-93314c9639a7"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:04:16.401399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-0c57edfb-c156-4040-8c63-c2ffa5c17b41 req-eb01b6f5-2404-4c5a-bcb5-bd263aed7dc9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.401900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-0c57edfb-c156-4040-8c63-c2ffa5c17b41 req-eb01b6f5-2404-4c5a-bcb5-bd263aed7dc9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.413532 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-0c57edfb-c156-4040-8c63-c2ffa5c17b41 req-eb01b6f5-2404-4c5a-bcb5-bd263aed7dc9 service nova] Creating event network-vif-deleted:8ba90739-57c2-4418-bf14-93314c9639a7 for instance 4083c205-6284-4602-ac2f-c515a2c55045 on hv-cinder-84721 Jun 22 20:04:16.418653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-0c57edfb-c156-4040-8c63-c2ffa5c17b41 req-eb01b6f5-2404-4c5a-bcb5-bd263aed7dc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212590 Jun 22 20:04:16.420641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 996/1587] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:16.950418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:16.951357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:16.962379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.963082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.964721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.965445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.998730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:16.999174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:16.999611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lazy-loading 'fault' on Instance uuid 4083c205-6284-4602-ac2f-c515a2c55045 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:04:17.044304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:17.052015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-581f7db4-4542-4525-9b1d-2931280ad940 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 200 len: 1311 microversion: 2.1 time: 0.108098 Jun 22 20:04:17.052648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 592/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:16 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:17.271616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:17.272369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:17.279200 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:17.279654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:17.280505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:17.280925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:17.412879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:17.422647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-90e28414-4ef2-45b2-90dc-1b9c93615b08 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1680 microversion: 2.1 time: 0.155364 Jun 22 20:04:17.423384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 997/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:17 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:18.069294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:18.069901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 4083c205-6284-4602-ac2f-c515a2c55045] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:18.077429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.077883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.078656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.079076 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.105000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] HTTP exception thrown: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Request method failure captured: Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 HTTP/1.1 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_Lr8z5JzgjQL9TYHcBPh0MLSB6eIRV-fljd_yD9TeLhhluFJLoUPohhGotgWlb3mXMAGp00Zc_NU44Rhb59-Zhd8UQ6_rgrPjbJhWSNfrPUHEnqvnjRvRNGGcRA5RIoY7P_Cd4aR29ttKB9KtyYXEMtwRE9lcCK-XyS-e-MjjUr0c Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:04:18.107331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8afcbe68ae6d4faea1026898d97882c8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: fe09f44c5fac46799e0d6883004151bf Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. Jun 22 20:04:18.109165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '4083c205-6284-4602-ac2f-c515a2c55045'} Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:04:18.110237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. Jun 22 20:04:18.111832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:18.113295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Returning 404 to user: Instance 4083c205-6284-4602-ac2f-c515a2c55045 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:04:18.113295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1056c028-705d-47b4-a92e-d41693f6f6e2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045" status: 404 len: 111 microversion: 2.1 time: 0.045715 Jun 22 20:04:18.113499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 593/1590] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:18 2022] GET /compute/v2.1/servers/4083c205-6284-4602-ac2f-c515a2c55045 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:04:18.121782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:18.122280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:18.130859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.131459 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.132436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.132987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.162637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:04:18.241013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-36dc1c55-ce7a-43f1-b373-e61f01f74b6a tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 204 len: 0 microversion: 2.1 time: 0.123117 Jun 22 20:04:18.241613 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 998/1591] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:04:18 2022] DELETE /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:04:18.249970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:18.250663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:18.256931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.257317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.258066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.258487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.394385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:18.402030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0042f7b6-b21b-49df-bca8-b0fd59b9c8dd tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.156281 Jun 22 20:04:18.402593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 594/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:18 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:18.434276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-fea706d6-d2e2-47df-875b-0a1c750f62ba req-c7d7a14f-1c04-49c6-b294-2974604f5f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c37a123d-0a0a-4dc6-963b-319f220a7be5", "name": "network-vif-deleted", "tag": "0422e19f-8a80-409f-8361-cd78795c9329"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:04:18.441329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:18.441735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:18.445191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-fea706d6-d2e2-47df-875b-0a1c750f62ba req-c7d7a14f-1c04-49c6-b294-2974604f5f1f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.445936 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-fea706d6-d2e2-47df-875b-0a1c750f62ba req-c7d7a14f-1c04-49c6-b294-2974604f5f1f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.448425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.449018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.449824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.450233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.462141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-fea706d6-d2e2-47df-875b-0a1c750f62ba req-c7d7a14f-1c04-49c6-b294-2974604f5f1f service nova] Creating event network-vif-deleted:0422e19f-8a80-409f-8361-cd78795c9329 for instance c37a123d-0a0a-4dc6-963b-319f220a7be5 on hv-cinder-84721 Jun 22 20:04:18.469767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-fea706d6-d2e2-47df-875b-0a1c750f62ba req-c7d7a14f-1c04-49c6-b294-2974604f5f1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039977 Jun 22 20:04:18.470975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 999/1593] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:18.492173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:18.492803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:18.493425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lazy-loading 'fault' on Instance uuid c37a123d-0a0a-4dc6-963b-319f220a7be5 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:04:18.539055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168c32f8fa8f4e07a8fc5418e9be4a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd644d637dd9e45f2b46f27435fe6097d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:18.547141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b523f120-c6f0-4249-9652-4421dd7efef3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 200 len: 1332 microversion: 2.1 time: 0.112145 Jun 22 20:04:18.548291 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 595/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:18 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:04:19.419607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:19.420340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:19.426937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:19.427378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:19.428144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:19.428605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:19.567561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:19.568464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:19.574830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:19.575284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:19.576053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:19.576547 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:19.584392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09f44c5fac46799e0d6883004151bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afcbe68ae6d4faea1026898d97882c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:04:19.594979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-77d99622-f3b8-4ec4-a0ab-49f428a677d6 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 200 len: 1521 microversion: 2.1 time: 0.179499 Jun 22 20:04:19.596885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1000/1595] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:19 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:04:19.610926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 HTTP/1.1 Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:04:19.612790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:04:19.614943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'c37a123d-0a0a-4dc6-963b-319f220a7be5'} Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:04:19.615889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:04:19.618199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:04:19.620638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:04:19.621686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7fb4ea00-260c-4e5b-a38b-4ef7e464653c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 404 len: 111 microversion: 2.1 time: 0.058646 Jun 22 20:04:19.622618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 596/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:19 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 20:04:19.632155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8b7c4464-ffc2-4f90-aeff-1b8da53f3058 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '.version_select at 0x7fdc1e463c10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:19.664353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8b7c4464-ffc2-4f90-aeff-1b8da53f3058 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155591304" status: 202 len: 0 microversion: 2.1 time: 0.036606 Jun 22 20:04:19.665511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1001/1597] 10.222.0.26 () {58 vars in 1220 bytes} [Wed Jun 22 20:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155591304 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:04:20.485044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-8c652e2c-5a79-44a0-99b8-795050feb683 req-70f4f0a5-191b-4221-ae78-5e9d7df17988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebc14a2-64d9-4c3a-b545-f37268103753", "name": "network-vif-deleted", "tag": "dc7075a1-3532-4915-adf8-c209858b35ef"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:04:20.493366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-8c652e2c-5a79-44a0-99b8-795050feb683 req-70f4f0a5-191b-4221-ae78-5e9d7df17988 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:20.493808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-8c652e2c-5a79-44a0-99b8-795050feb683 req-70f4f0a5-191b-4221-ae78-5e9d7df17988 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:20.505158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-8c652e2c-5a79-44a0-99b8-795050feb683 req-70f4f0a5-191b-4221-ae78-5e9d7df17988 service nova] Creating event network-vif-deleted:dc7075a1-3532-4915-adf8-c209858b35ef for instance 9ebc14a2-64d9-4c3a-b545-f37268103753 on hv-cinder-84721 Jun 22 20:04:20.510222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-8c652e2c-5a79-44a0-99b8-795050feb683 req-70f4f0a5-191b-4221-ae78-5e9d7df17988 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029052 Jun 22 20:04:20.510793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 597/1598] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:20.613430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:20.614034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] [instance: 9ebc14a2-64d9-4c3a-b545-f37268103753] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:04:20.620369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:20.620813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:20.621573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:04:20.621975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:04:20.635315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] HTTP exception thrown: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Request method failure captured: Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 HTTP/1.1 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_Lr8z5JzgjQL9TYHcBPh0MLSB6eIRV-fljd_yD9TeLhhluFJLoUPohhGotgWlb3mXMAGp00Zc_NU44Rhb59-Zhd8UQ6_rgrPjbJhWSNfrPUHEnqvnjRvRNGGcRA5RIoY7P_Cd4aR29ttKB9KtyYXEMtwRE9lcCK-XyS-e-MjjUr0c Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:04:20.636975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8afcbe68ae6d4faea1026898d97882c8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8afcbe68ae6d4faea1026898d97882c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 8afcbe68ae6d4faea1026898d97882c8 Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984819328 Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: fe09f44c5fac46799e0d6883004151bf Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984819328-project Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. Jun 22 20:04:20.638558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '9ebc14a2-64d9-4c3a-b545-f37268103753'} Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:04:20.639474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. Jun 22 20:04:20.641282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:04:20.642659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] Returning 404 to user: Instance 9ebc14a2-64d9-4c3a-b545-f37268103753 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:04:20.642659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2e728610-41d5-400b-a59b-a6e333748cb2 tempest-ServerRescueNegativeTestJSON-984819328 tempest-ServerRescueNegativeTestJSON-984819328-project] 10.222.0.26 "GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753" status: 404 len: 111 microversion: 2.1 time: 0.029303 Jun 22 20:04:20.642659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1002/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:04:20 2022] GET /compute/v2.1/servers/9ebc14a2-64d9-4c3a-b545-f37268103753 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:04:25.208819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ece4cdb8-d068-467f-a140-b3c9a0ce9e7a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Action: 'create', calling method: .version_select at 0x7fdc19cf00d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-939636542", "metadata": {"Type": "work"}}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:04:25.512930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ece4cdb8-d068-467f-a140-b3c9a0ce9e7a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.423301 Jun 22 20:04:25.513562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 598/1600] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jun 22 20:04:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 20:04:25.524995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-18c6c55e-4dea-45a3-b408-d87b230ba018 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:25.576189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-18c6c55e-4dea-45a3-b408-d87b230ba018 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.054887 Jun 22 20:04:25.576876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1003/1601] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:26.597195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-05c2ad74-22f4-481c-9985-203c01c8098a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cb5af0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:26.655118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-05c2ad74-22f4-481c-9985-203c01c8098a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065263 Jun 22 20:04:26.655689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 599/1602] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:27.671527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b29cd4c4-5215-4a08-951a-ca3c15ccbfb3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4625e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:27.727382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b29cd4c4-5215-4a08-951a-ca3c15ccbfb3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062568 Jun 22 20:04:27.727953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1004/1603] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:28.745439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5a44aeb9-a4aa-4d7c-8347-2b67bc356f81 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7e1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:28.793542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5a44aeb9-a4aa-4d7c-8347-2b67bc356f81 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055412 Jun 22 20:04:28.794122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 600/1604] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:29.807735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-de8129c0-da1a-4f7a-97f1-9fa6ab6f653f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:29.860499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-de8129c0-da1a-4f7a-97f1-9fa6ab6f653f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057767 Jun 22 20:04:29.861067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1005/1605] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:30.873399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:30.874392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:30.881443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-28b4408e-3580-4621-91ab-9623c43b1b8a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1aed30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:30.932297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-28b4408e-3580-4621-91ab-9623c43b1b8a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061267 Jun 22 20:04:30.932903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 601/1606] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:31.944413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:31.945802 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:04:31.952564 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-357538b1-7435-4375-9378-0ffc38c52fed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c5fc10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:32.006444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-357538b1-7435-4375-9378-0ffc38c52fed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063530 Jun 22 20:04:32.007165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1006/1607] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:33.024434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-db695ec3-da74-4c33-b96e-f1eeb7938b3e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf0ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:33.079756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-db695ec3-da74-4c33-b96e-f1eeb7938b3e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062425 Jun 22 20:04:33.080368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 602/1608] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:34.093395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6cb35dba-8b97-49db-9fee-e722849df9f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:34.141175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6cb35dba-8b97-49db-9fee-e722849df9f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052022 Jun 22 20:04:34.141739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1007/1609] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:35.158856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c782f46b-cff9-4dd6-952c-bfb053cdc527 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e7b160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:35.219772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c782f46b-cff9-4dd6-952c-bfb053cdc527 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.068327 Jun 22 20:04:35.220432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 603/1610] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:36.237402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-684c8488-b09f-4f8b-b247-20ca34f7f47d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462160>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:36.290154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-684c8488-b09f-4f8b-b247-20ca34f7f47d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060048 Jun 22 20:04:36.290759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1008/1611] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:37.307849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ec57bb8a-b286-46be-9a25-9bd7cd5cbb34 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf0ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:37.363234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ec57bb8a-b286-46be-9a25-9bd7cd5cbb34 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062711 Jun 22 20:04:37.363811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 604/1612] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:38.378966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4b7008e3-fe98-46a5-a859-fb6cc3a1181a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450310>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:38.430456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4b7008e3-fe98-46a5-a859-fb6cc3a1181a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056577 Jun 22 20:04:38.431161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1009/1613] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:39.448151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-65fe10d3-f651-48ec-9ee0-5d991dec2c7a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fc3d30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:39.506156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-65fe10d3-f651-48ec-9ee0-5d991dec2c7a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065425 Jun 22 20:04:39.506719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 605/1614] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:40.520981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-559284cf-e6c0-4d26-a011-d3c6fa86ce7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:40.570953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-559284cf-e6c0-4d26-a011-d3c6fa86ce7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.054879 Jun 22 20:04:40.571530 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1010/1615] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:41.584587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-864b533e-7f0a-4c6e-9e54-d4bbb09a6d3e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bf23a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:41.633114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-864b533e-7f0a-4c6e-9e54-d4bbb09a6d3e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052836 Jun 22 20:04:41.633626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 606/1616] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:42.650656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-071ab72d-f9cb-440b-ba72-e4e0ba902a1e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4668b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:42.701444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-071ab72d-f9cb-440b-ba72-e4e0ba902a1e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058088 Jun 22 20:04:42.702018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1011/1617] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:43.719638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ce95d20e-1b6e-4ff2-88bb-acc1e6d49362 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1a6160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:43.774237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ce95d20e-1b6e-4ff2-88bb-acc1e6d49362 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062281 Jun 22 20:04:43.774805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 607/1618] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:44.791710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e5249e72-df85-4799-bf99-5e3d76dc01e4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c5fc10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:44.854416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e5249e72-df85-4799-bf99-5e3d76dc01e4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.069864 Jun 22 20:04:44.855007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1012/1619] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:45.868817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ea062690-f396-4334-b588-90793cd05796 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf0ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:45.917530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ea062690-f396-4334-b588-90793cd05796 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053339 Jun 22 20:04:45.918279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 608/1620] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:46.933193 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ac3340f4-7a52-46f3-ac39-6e882bcf3519 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:46.988394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ac3340f4-7a52-46f3-ac39-6e882bcf3519 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061023 Jun 22 20:04:46.988913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1013/1621] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:48.005086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-790bb82e-6204-43e7-ab5d-a3b846276c46 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d19280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:48.056868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-790bb82e-6204-43e7-ab5d-a3b846276c46 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058035 Jun 22 20:04:48.061675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 609/1622] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:49.074251 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1afcf8ea-815c-42cf-b286-da766e34c420 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d8b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:49.133327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1afcf8ea-815c-42cf-b286-da766e34c420 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066424 Jun 22 20:04:49.133930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1014/1623] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:50.151021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1b733721-0c92-40de-9ea4-3cd10272f5de tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf09d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:50.202214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1b733721-0c92-40de-9ea4-3cd10272f5de tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058315 Jun 22 20:04:50.202779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 610/1624] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:51.219834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5189c451-a6ca-4452-b0ff-22839cb4512a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4639d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:51.278017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5189c451-a6ca-4452-b0ff-22839cb4512a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065650 Jun 22 20:04:51.278581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1015/1625] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:52.294811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cae02ae3-fc75-4dae-b6be-e8499a50655f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1a6700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:52.363836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cae02ae3-fc75-4dae-b6be-e8499a50655f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.076446 Jun 22 20:04:52.364473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 611/1626] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:53.381460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-68322405-39b7-4280-8ba2-22632141fca8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466550>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:53.433517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-68322405-39b7-4280-8ba2-22632141fca8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059343 Jun 22 20:04:53.434081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1016/1627] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:54.450889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-859e96d9-28eb-4096-b384-a5aca76bc753 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3e1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:54.501883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-859e96d9-28eb-4096-b384-a5aca76bc753 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058059 Jun 22 20:04:54.502671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 612/1628] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:55.514966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-96fbc5a2-cb32-4d5c-ad84-6e8bf698937d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e476b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:55.562827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-96fbc5a2-cb32-4d5c-ad84-6e8bf698937d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052041 Jun 22 20:04:55.563401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1017/1629] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:56.585439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6ea73385-295e-4fc4-b64c-e24a5b1c3fa5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a028160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:56.641106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6ea73385-295e-4fc4-b64c-e24a5b1c3fa5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063968 Jun 22 20:04:56.641680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 613/1630] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:57.654770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aed14bf2-1ca0-4f8a-85a8-f8e165d19243 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e455ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:57.701638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aed14bf2-1ca0-4f8a-85a8-f8e165d19243 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051204 Jun 22 20:04:57.706497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1018/1631] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:58.719558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9426c156-5f77-4bbf-91d3-48f55472b732 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d190d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:58.774855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9426c156-5f77-4bbf-91d3-48f55472b732 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062902 Jun 22 20:04:58.775587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 614/1632] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:04:59.793147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cd658c30-9520-4fe1-be21-534c98d3f072 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:04:59.850591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cd658c30-9520-4fe1-be21-534c98d3f072 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065347 Jun 22 20:04:59.851151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1019/1633] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:04:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:00.867135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7746da66-380e-428a-9186-7b3dd19f7cbd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ce6310>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:00.921214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7746da66-380e-428a-9186-7b3dd19f7cbd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060455 Jun 22 20:05:00.921852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 615/1634] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:01.939901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bfa799f4-906e-4877-9918-a337326475ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d5e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:01.989879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bfa799f4-906e-4877-9918-a337326475ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057682 Jun 22 20:05:01.990475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1020/1635] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:03.007723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f540a27f-db70-4c67-b24a-da28f935d19a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3ec10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:03.061556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f540a27f-db70-4c67-b24a-da28f935d19a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061056 Jun 22 20:05:03.062125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 616/1636] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:04.078909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ab8d55cf-3f40-48f7-9115-7d67f4a140e7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:04.128570 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ab8d55cf-3f40-48f7-9115-7d67f4a140e7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056868 Jun 22 20:05:04.129288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1021/1637] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:05.143897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24fdf5bc-cdfe-43b9-88a4-17fb1af4b038 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:05.198789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24fdf5bc-cdfe-43b9-88a4-17fb1af4b038 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060993 Jun 22 20:05:05.203957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 617/1638] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:06.216643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-209b863f-7f97-41d4-b689-fbca1cb3dfb1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466c10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:06.272009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-209b863f-7f97-41d4-b689-fbca1cb3dfb1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062949 Jun 22 20:05:06.272607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1022/1639] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:07.285106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5abb1972-1be2-4276-92a4-1cae1f493e63 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a05bb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:07.334692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5abb1972-1be2-4276-92a4-1cae1f493e63 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053886 Jun 22 20:05:07.335331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 618/1640] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:08.352386 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8da27030-1008-43af-b0af-faa656efd7c1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e02f70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:08.407226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8da27030-1008-43af-b0af-faa656efd7c1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061965 Jun 22 20:05:08.407795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1023/1641] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:09.421602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0838d6e7-868e-498d-b5af-77ea6c48a89f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:09.474134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0838d6e7-868e-498d-b5af-77ea6c48a89f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058448 Jun 22 20:05:09.474745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 619/1642] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:10.491473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2f88a5ee-492f-414a-b9e8-613944199acc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4663a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:10.539445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2f88a5ee-492f-414a-b9e8-613944199acc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055080 Jun 22 20:05:10.540036 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1024/1643] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:11.555715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5845ad69-6969-4a44-b136-4cc826e8989f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cd70d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:11.605665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5845ad69-6969-4a44-b136-4cc826e8989f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055950 Jun 22 20:05:11.606217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 620/1644] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:12.622729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3f6e7a70-0a5f-462a-9d98-b05da81e78e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:12.673519 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3f6e7a70-0a5f-462a-9d98-b05da81e78e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057768 Jun 22 20:05:12.674073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1025/1645] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:13.691362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9f2459b1-a590-4247-bb42-51a634361691 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7e1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:13.748707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9f2459b1-a590-4247-bb42-51a634361691 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064770 Jun 22 20:05:13.749278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 621/1646] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:14.769168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb81af05-b03e-4c80-8ce2-8e00aeee2ee5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e52eee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:14.943373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb81af05-b03e-4c80-8ce2-8e00aeee2ee5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.179579 Jun 22 20:05:14.943951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1026/1647] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:15.961587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8069df31-2ff2-443e-a8f7-4b3c3bab10d1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fc3d30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:16.067668 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8069df31-2ff2-443e-a8f7-4b3c3bab10d1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.113685 Jun 22 20:05:16.069655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 622/1648] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:05:17.085769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ea3fc173-7f2a-4552-ad77-6682abd2313f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:17.141237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ea3fc173-7f2a-4552-ad77-6682abd2313f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063000 Jun 22 20:05:17.141788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1027/1649] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:18.158779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-25b0cf60-dafa-47dd-a908-6992014cf14a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:18.214329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-25b0cf60-dafa-47dd-a908-6992014cf14a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062969 Jun 22 20:05:18.214995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 623/1650] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:19.232477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e3b3278a-6b09-407d-b446-04cdeb73a94a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4663a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:19.285426 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e3b3278a-6b09-407d-b446-04cdeb73a94a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060896 Jun 22 20:05:19.286027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1028/1651] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:20.302416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-281ad464-cda5-4231-8fd9-476b5f8d63fa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf05e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:20.359820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-281ad464-cda5-4231-8fd9-476b5f8d63fa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063993 Jun 22 20:05:20.360393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 624/1652] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:21.377642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-794e3ad3-126d-43da-9197-82470ed0da67 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:21.445197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-794e3ad3-126d-43da-9197-82470ed0da67 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.074957 Jun 22 20:05:21.445868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1029/1653] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:22.463482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3683aa3c-b0a7-479b-bd49-75d3e9a6aae3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d190d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:22.512339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3683aa3c-b0a7-479b-bd49-75d3e9a6aae3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056669 Jun 22 20:05:22.512924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 625/1654] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:22 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:23.525693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1ed54e1e-af87-405d-b08b-e9583813de39 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:23.573528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1ed54e1e-af87-405d-b08b-e9583813de39 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052584 Jun 22 20:05:23.574099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1030/1655] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:24.591463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-116f0e48-d4ff-41b7-a4ee-dc034f69769d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1a6160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:24.642699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-116f0e48-d4ff-41b7-a4ee-dc034f69769d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058944 Jun 22 20:05:24.643271 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 626/1656] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:25.658562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7817a733-b063-4bef-9dfa-06b10744d9e4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:25.708545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7817a733-b063-4bef-9dfa-06b10744d9e4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055648 Jun 22 20:05:25.709120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1031/1657] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:26.726238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-79b67b7e-7ac2-4902-bbc7-487eabe7a781 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:26.776449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-79b67b7e-7ac2-4902-bbc7-487eabe7a781 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057329 Jun 22 20:05:26.777010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 627/1658] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:26.815013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:05:26.815415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:05:27.794026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61a3fb29-415f-4c90-8b62-ec08082eeac6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4713a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:27.848859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61a3fb29-415f-4c90-8b62-ec08082eeac6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062218 Jun 22 20:05:27.849409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1032/1659] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:28.865695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a0a47e95-8cce-41c0-a929-f4111f4e55c6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fc3ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:28.917160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a0a47e95-8cce-41c0-a929-f4111f4e55c6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058513 Jun 22 20:05:28.917737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 628/1660] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:29.934835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7b37a58e-580c-4f61-96f7-9ded927c5004 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463af0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:29.983722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7b37a58e-580c-4f61-96f7-9ded927c5004 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056280 Jun 22 20:05:29.984313 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1033/1661] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:31.001209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d0ac8edf-84d3-4e80-87a0-ed33efb8a488 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:31.053972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d0ac8edf-84d3-4e80-87a0-ed33efb8a488 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059995 Jun 22 20:05:31.054541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 629/1662] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:32.071543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0de2ae06-7c88-4bc9-837a-bb045c706ae5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:32.128507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0de2ae06-7c88-4bc9-837a-bb045c706ae5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064051 Jun 22 20:05:32.129436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1034/1663] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:32 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:33.145081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-75b8ef0e-80ab-4cc8-8bdd-a7a88801f968 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fc3ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:33.202726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-75b8ef0e-80ab-4cc8-8bdd-a7a88801f968 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063363 Jun 22 20:05:33.203334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 630/1664] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:34.220425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-41708246-7695-4573-a6c1-7125f82c775a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:34.278587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-41708246-7695-4573-a6c1-7125f82c775a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065145 Jun 22 20:05:34.279168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1035/1665] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:34.765314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:05:34.766167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:05:35.296092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4a98ae88-41df-454c-b91f-ec107851fa67 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e50f940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:35.351063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4a98ae88-41df-454c-b91f-ec107851fa67 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062201 Jun 22 20:05:35.351628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 631/1666] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:35.968774 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:05:35.969751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:05:36.368646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-049237a0-916f-4553-b822-3d76d9c08678 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:36.418840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-049237a0-916f-4553-b822-3d76d9c08678 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057619 Jun 22 20:05:36.419377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1036/1667] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:37.435457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-58fefc03-0ef4-42a4-8b7e-03b583629a72 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3e9d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:37.485207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-58fefc03-0ef4-42a4-8b7e-03b583629a72 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056816 Jun 22 20:05:37.485782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 632/1668] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:38.498585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d5bb9f52-378b-4b63-afad-869f22ce36da tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479af0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:38.551182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d5bb9f52-378b-4b63-afad-869f22ce36da tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056948 Jun 22 20:05:38.551731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1037/1669] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:39.567592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e9aef0e-1438-4457-af2f-6e6ed7a8ca5d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045430>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:39.618126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e9aef0e-1438-4457-af2f-6e6ed7a8ca5d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057658 Jun 22 20:05:39.618714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 633/1670] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:40.636057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-04cb3a1c-f3d5-4dd3-a1f2-4e74d6018ded tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:40.687231 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-04cb3a1c-f3d5-4dd3-a1f2-4e74d6018ded tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058641 Jun 22 20:05:40.687793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1038/1671] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:41.704404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d3e75488-bc48-411b-b3f5-e5a6f7578e1f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ce6790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:41.759522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d3e75488-bc48-411b-b3f5-e5a6f7578e1f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062117 Jun 22 20:05:41.760148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 634/1672] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:42.776853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e0d5d4da-e7b0-4d8e-96dc-0f620952c6bd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9b790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:42.833969 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e0d5d4da-e7b0-4d8e-96dc-0f620952c6bd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064156 Jun 22 20:05:42.834531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1039/1673] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:43.850479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4078c72e-ce77-4d79-9aaa-eb97936048ae tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045f70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:43.897723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4078c72e-ce77-4d79-9aaa-eb97936048ae tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053271 Jun 22 20:05:43.898282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 635/1674] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:44.915275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-54ca698f-f541-45a6-beb7-91840a51d5d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d8b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:44.972990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-54ca698f-f541-45a6-beb7-91840a51d5d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064961 Jun 22 20:05:44.973543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1040/1675] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:45.990718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8626019c-b492-4eb0-b11d-6a37b8173763 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3ec10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:46.049979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8626019c-b492-4eb0-b11d-6a37b8173763 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066694 Jun 22 20:05:46.054804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 636/1676] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:47.063761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9c73b5c0-56da-47b7-a91b-491b78d12bf6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:47.116547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9c73b5c0-56da-47b7-a91b-491b78d12bf6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057421 Jun 22 20:05:47.117119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1041/1677] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:48.131117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-87b4a090-e46f-48e3-8b1b-4a021ba3aaed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19f24160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:48.179123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-87b4a090-e46f-48e3-8b1b-4a021ba3aaed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053104 Jun 22 20:05:48.179811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 637/1678] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:49.195610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-039b6aff-9deb-47e3-8274-b78bd3d58ecb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:49.246421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-039b6aff-9deb-47e3-8274-b78bd3d58ecb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056829 Jun 22 20:05:49.246858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1042/1679] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:50.258654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-01aaa0a0-fba0-470f-9c27-91356d5ed3dc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:50.306153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-01aaa0a0-fba0-470f-9c27-91356d5ed3dc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051843 Jun 22 20:05:50.306759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 638/1680] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:51.323545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1156a74c-f436-4d41-8098-e706365ade10 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e476b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:51.380349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1156a74c-f436-4d41-8098-e706365ade10 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064041 Jun 22 20:05:51.380899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1043/1681] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:52.396839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9bb237ed-834a-4bd3-a61a-42c3fabb77b1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:52.443820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9bb237ed-834a-4bd3-a61a-42c3fabb77b1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053212 Jun 22 20:05:52.444422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 639/1682] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:53.461238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-149e9611-21c9-4186-979f-c04a7384028e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:53.516773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-149e9611-21c9-4186-979f-c04a7384028e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062630 Jun 22 20:05:53.517415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1044/1683] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:54.534144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-39fc770e-a0d1-4933-bd25-b1cd28ffce9d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4ef70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:54.589974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-39fc770e-a0d1-4933-bd25-b1cd28ffce9d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062913 Jun 22 20:05:54.590538 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 640/1684] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:55.604742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-69eb5b64-9c67-4da2-86ee-62cc1f5d94e6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9b790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:55.652807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-69eb5b64-9c67-4da2-86ee-62cc1f5d94e6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052574 Jun 22 20:05:55.653366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1045/1685] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:56.670708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-81423b5a-862c-40b4-9d96-a33e17bb3886 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c050d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:56.729259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-81423b5a-862c-40b4-9d96-a33e17bb3886 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065877 Jun 22 20:05:56.729853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 641/1686] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:57.747122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-678b4f76-4671-4fb7-8e21-78f4d92202e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46dc10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:57.805276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-678b4f76-4671-4fb7-8e21-78f4d92202e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065507 Jun 22 20:05:57.805837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1046/1687] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:58.821752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b7b52ba9-ef12-46f8-ae01-eb4218590eb8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19f24280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:58.873676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b7b52ba9-ef12-46f8-ae01-eb4218590eb8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058118 Jun 22 20:05:58.874484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 642/1688] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:05:59.890995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1fde8b81-e1e0-47d5-bb53-d3b5d0ba4844 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9b790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:05:59.940379 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1fde8b81-e1e0-47d5-bb53-d3b5d0ba4844 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056289 Jun 22 20:05:59.940952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1047/1689] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:05:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:00.958036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-023487bc-a1ca-446c-ab17-a0cbe7520dc5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5e550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:01.012733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-023487bc-a1ca-446c-ab17-a0cbe7520dc5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062802 Jun 22 20:06:01.013281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 643/1690] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:02.030540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-efc37013-0cc1-44d3-af0a-6485a73641eb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:02.085297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-efc37013-0cc1-44d3-af0a-6485a73641eb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061865 Jun 22 20:06:02.085869 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1048/1691] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:03.102555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6952ab68-5e40-429f-a1fe-fa5c0f3fb79f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19f24280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:03.162314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6952ab68-5e40-429f-a1fe-fa5c0f3fb79f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066144 Jun 22 20:06:03.163121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 644/1692] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:04.180054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-81ae69ad-4abd-407c-a1f1-1f92a74df4a3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:04.231473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-81ae69ad-4abd-407c-a1f1-1f92a74df4a3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058527 Jun 22 20:06:04.232065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1049/1693] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:05.248961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0c367353-28ca-44d3-8d31-8c1e7f051e80 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c050d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:05.307509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0c367353-28ca-44d3-8d31-8c1e7f051e80 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065732 Jun 22 20:06:05.308085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 645/1694] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:06.323352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ccbb3ffc-acb8-4a91-a84f-dd51144d9925 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479c10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:06.377487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ccbb3ffc-acb8-4a91-a84f-dd51144d9925 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060044 Jun 22 20:06:06.378047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1050/1695] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:07.392914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8eb3488f-e892-4879-9543-abcd4e53eeba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cfb820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:07.447982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8eb3488f-e892-4879-9543-abcd4e53eeba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061371 Jun 22 20:06:07.448812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 646/1696] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:08.464673 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9b50d08b-07f0-460c-a521-365683301bdb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:08.514850 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9b50d08b-07f0-460c-a521-365683301bdb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056576 Jun 22 20:06:08.515409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1051/1697] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:09.531622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b0a1c12b-9d70-41e8-b87a-8bd05ed9c656 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bf23a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:09.581310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b0a1c12b-9d70-41e8-b87a-8bd05ed9c656 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056771 Jun 22 20:06:09.581874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 647/1698] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:10.599104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d620383b-2a71-48f0-bf56-a5684b43e006 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466550>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:10.657563 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d620383b-2a71-48f0-bf56-a5684b43e006 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065641 Jun 22 20:06:10.658125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1052/1699] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:11.671314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-96254d38-e8cb-4f45-b652-7c0d836b2484 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4e3a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:11.718365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-96254d38-e8cb-4f45-b652-7c0d836b2484 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051413 Jun 22 20:06:11.718929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 648/1700] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:12.736425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7f0efc12-99d5-4bb3-add1-de58a88a2a2a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9be50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:12.786829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7f0efc12-99d5-4bb3-add1-de58a88a2a2a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058257 Jun 22 20:06:12.787373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1053/1701] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:13.803652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-03639fec-27e4-4e3e-bee3-b4e119756dd0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19beab80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:13.854452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-03639fec-27e4-4e3e-bee3-b4e119756dd0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058010 Jun 22 20:06:13.855167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 649/1702] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:14.871681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a8b9a961-3028-45e1-acd8-2b71d2fd1fb6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48eb80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:14.929320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a8b9a961-3028-45e1-acd8-2b71d2fd1fb6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064095 Jun 22 20:06:14.929911 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1054/1703] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:15.947721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d4317a2f-dad2-47fb-9a4b-d11294f3c757 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5eb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:16.001742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d4317a2f-dad2-47fb-9a4b-d11294f3c757 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061219 Jun 22 20:06:16.002288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 650/1704] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:17.019356 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5b630ae7-85b5-40b0-8ce5-fee248c909ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4668b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:17.075546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5b630ae7-85b5-40b0-8ce5-fee248c909ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063562 Jun 22 20:06:17.076130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1055/1705] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:18.094197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-329fb4f0-4473-40f7-93d0-1fbac5321915 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4e160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:18.156764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-329fb4f0-4473-40f7-93d0-1fbac5321915 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.070335 Jun 22 20:06:18.157340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 651/1706] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:19.175057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ca53d03-9e90-48da-ac59-b4ec3ddf575a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:19.237460 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ca53d03-9e90-48da-ac59-b4ec3ddf575a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.070122 Jun 22 20:06:19.238013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1056/1707] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:20.251279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b0528ebf-7fdd-472f-a6bf-0b3d05ad51b7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ce6ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:20.298657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b0528ebf-7fdd-472f-a6bf-0b3d05ad51b7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051761 Jun 22 20:06:20.299267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 652/1708] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:21.315395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-af969366-f013-4ecb-8e40-af5a8a60cb07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:21.366771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-af969366-f013-4ecb-8e40-af5a8a60cb07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058491 Jun 22 20:06:21.367327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1057/1709] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:22.381213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5efc513-d8de-458f-9311-a0bb4d1c8763 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cd70d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:22.436546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a5efc513-d8de-458f-9311-a0bb4d1c8763 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060116 Jun 22 20:06:22.437115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 653/1710] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:22 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:23.453768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-86eeb765-4f27-4f1b-9a1b-35592c5c0ca1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46a3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:23.506996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-86eeb765-4f27-4f1b-9a1b-35592c5c0ca1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060424 Jun 22 20:06:23.507569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1058/1711] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:24.520721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-608f6131-af4b-4e2d-a023-8a24fa5e32a1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:24.569707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-608f6131-af4b-4e2d-a023-8a24fa5e32a1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053436 Jun 22 20:06:24.570268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 654/1712] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:25.582887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-87beea3e-7ac9-4ce3-9d1c-a5a6e3511983 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9b040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:25.630006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-87beea3e-7ac9-4ce3-9d1c-a5a6e3511983 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051369 Jun 22 20:06:25.630597 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1059/1713] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:26.646113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8a8a7a4c-931f-498e-a0c9-20963aaa2c03 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e7b700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:26.702543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8a8a7a4c-931f-498e-a0c9-20963aaa2c03 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063363 Jun 22 20:06:26.703104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 655/1714] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:27.719940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa2d49c8-8359-41c1-8dcf-42ee34a9d6a9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:27.773227 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa2d49c8-8359-41c1-8dcf-42ee34a9d6a9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060155 Jun 22 20:06:27.773818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1060/1715] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:28.787967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f61caab9-42d4-4f75-a810-fae349a1132e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5e5e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:28.838744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f61caab9-42d4-4f75-a810-fae349a1132e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056830 Jun 22 20:06:28.839349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 656/1716] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:29.852430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1252dc94-c8b3-4ad8-86f6-933fb1dbb205 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:29.900646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1252dc94-c8b3-4ad8-86f6-933fb1dbb205 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052746 Jun 22 20:06:29.901284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1061/1717] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:30.918739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e7d6e309-d70b-49d7-a306-2b981c39fc5b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4e040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:30.974824 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e7d6e309-d70b-49d7-a306-2b981c39fc5b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063367 Jun 22 20:06:30.975414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 657/1718] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:31.992631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e1898ad8-7fac-48c4-a615-7edf47b57d00 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:32.048315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e1898ad8-7fac-48c4-a615-7edf47b57d00 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062837 Jun 22 20:06:32.048887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1062/1719] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:33.066241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-69c93f76-b302-462f-839b-20bfd21fe81b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e50f940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:33.124522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-69c93f76-b302-462f-839b-20bfd21fe81b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065849 Jun 22 20:06:33.125346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 658/1720] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:34.142809 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fe08cdf3-45b1-4a63-a2c2-2fc0eb275fdc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46dee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:34.197318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fe08cdf3-45b1-4a63-a2c2-2fc0eb275fdc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061754 Jun 22 20:06:34.197882 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1063/1721] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:35.214786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fb400926-5fc0-4ef9-8f3c-4f388a9f1496 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4eb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:35.264400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fb400926-5fc0-4ef9-8f3c-4f388a9f1496 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057414 Jun 22 20:06:35.265011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 659/1722] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:36.281395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e90bd5eb-ec3e-42df-999e-80a01b702e64 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:36.335619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e90bd5eb-ec3e-42df-999e-80a01b702e64 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061494 Jun 22 20:06:36.336215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1064/1723] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:37.353616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-451012ce-8b86-4650-ba41-0537e84e0057 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:37.409932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-451012ce-8b86-4650-ba41-0537e84e0057 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063792 Jun 22 20:06:37.410608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 660/1724] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:38.429750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fcfdd485-d8e0-44aa-b9a2-e3005e471719 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:38.488360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fcfdd485-d8e0-44aa-b9a2-e3005e471719 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065898 Jun 22 20:06:38.488932 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1065/1725] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:39.502151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b61e922f-ee7b-4e3c-a4e1-19abdf4c437e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:39.549914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b61e922f-ee7b-4e3c-a4e1-19abdf4c437e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052471 Jun 22 20:06:39.550488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 661/1726] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:40.568018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-347d22b8-9623-4abb-b4be-cc412c8cbd90 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:40.621829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-347d22b8-9623-4abb-b4be-cc412c8cbd90 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061047 Jun 22 20:06:40.622399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1066/1727] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:41.638864 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9403e7d9-5da5-4085-901c-5f4fbf40e919 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045af0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:41.696414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9403e7d9-5da5-4085-901c-5f4fbf40e919 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064977 Jun 22 20:06:41.696996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 662/1728] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:42.714675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-41459a58-e8dc-4814-9605-ce0fab7b53bc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e455430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:42.775476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-41459a58-e8dc-4814-9605-ce0fab7b53bc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.068576 Jun 22 20:06:42.776054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1067/1729] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:43.793582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ad5921db-b7c1-4999-91ef-e89bd1d84222 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:43.849476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ad5921db-b7c1-4999-91ef-e89bd1d84222 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063641 Jun 22 20:06:43.850079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 663/1730] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:44.866669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-51483c78-81a6-4b7f-892c-31e8666eff7b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:44.918524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-51483c78-81a6-4b7f-892c-31e8666eff7b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058879 Jun 22 20:06:44.919087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1068/1731] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:45.936516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7a39eae7-b3e8-4a59-88af-68eb3f6ddffa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d19550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:45.993489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7a39eae7-b3e8-4a59-88af-68eb3f6ddffa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064822 Jun 22 20:06:45.994049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 664/1732] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:47.006983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6315af6c-d5dd-4901-9865-9c7b66c9e171 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46db80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:47.053375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6315af6c-d5dd-4901-9865-9c7b66c9e171 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.050717 Jun 22 20:06:47.053953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1069/1733] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:48.070922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b247a0a4-ab9b-4193-9ac5-15df0898fe06 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1ba40700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:48.130083 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b247a0a4-ab9b-4193-9ac5-15df0898fe06 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066423 Jun 22 20:06:48.130653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 665/1734] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:49.147579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f60cd114-cc88-4dbe-aaaa-cf96a5c2aeff tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e415700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:49.202558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f60cd114-cc88-4dbe-aaaa-cf96a5c2aeff tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062248 Jun 22 20:06:49.203139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1070/1735] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:50.221915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-546dd30e-b080-4811-81b0-ab8a63f7eb48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045a60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:50.275792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-546dd30e-b080-4811-81b0-ab8a63f7eb48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061807 Jun 22 20:06:50.276404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 666/1736] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:51.293275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f0e5bd62-73ed-4965-82da-7bfa2b791d49 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:51.344991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f0e5bd62-73ed-4965-82da-7bfa2b791d49 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058997 Jun 22 20:06:51.345590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1071/1737] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:52.362485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42f48b9f-f091-4af0-b216-81c240a15419 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a028ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:52.418577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42f48b9f-f091-4af0-b216-81c240a15419 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063159 Jun 22 20:06:52.419190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 667/1738] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:53.437094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c4a5e77c-094d-4683-bf38-7e665d2eabb0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46a0d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:53.495288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c4a5e77c-094d-4683-bf38-7e665d2eabb0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065693 Jun 22 20:06:53.495878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1072/1739] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:54.511521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dd3de4cd-8041-4624-b22a-e450c9695e74 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ed2040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:54.559424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dd3de4cd-8041-4624-b22a-e450c9695e74 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.054767 Jun 22 20:06:54.559990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 668/1740] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:55.577369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-91e197c5-a180-45c8-91d1-8d17ccf56614 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:55.630747 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-91e197c5-a180-45c8-91d1-8d17ccf56614 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060884 Jun 22 20:06:55.631336 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1073/1741] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:56.648694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d46bf2d8-e1a7-468e-9d49-e4c131f81aa2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d19c10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:56.702166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d46bf2d8-e1a7-468e-9d49-e4c131f81aa2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060905 Jun 22 20:06:56.702895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 669/1742] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:57.720173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9919aa0a-2de2-491c-970b-34710d099fd6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46ac10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:57.778165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9919aa0a-2de2-491c-970b-34710d099fd6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065123 Jun 22 20:06:57.778728 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1074/1743] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:58.794855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e23fdb8d-2886-4ea5-b7e8-733c7a405b4d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf0a60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:58.844430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e23fdb8d-2886-4ea5-b7e8-733c7a405b4d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055912 Jun 22 20:06:58.845002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 670/1744] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:06:59.857757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4f0a6c8f-fee9-4880-88cc-b4185e6de7f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4bc9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:06:59.907132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4f0a6c8f-fee9-4880-88cc-b4185e6de7f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053758 Jun 22 20:06:59.907724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1075/1745] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:06:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:00.924031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85db2b62-955b-4573-a541-6ecda81b0cec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d19c10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:00.976888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85db2b62-955b-4573-a541-6ecda81b0cec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060312 Jun 22 20:07:00.977495 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 671/1746] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:01.996490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a1ab6701-91b1-4df2-9ab4-1b507b0d6dc9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:02.053017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a1ab6701-91b1-4df2-9ab4-1b507b0d6dc9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065675 Jun 22 20:07:02.053588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1076/1747] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:03.071713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-47fa4ac3-0c9d-4583-9256-703feb613f61 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:03.126110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-47fa4ac3-0c9d-4583-9256-703feb613f61 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061503 Jun 22 20:07:03.126675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 672/1748] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:04.142986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4005fce4-5406-4513-ad4a-ea420f9e359a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:04.195742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4005fce4-5406-4513-ad4a-ea420f9e359a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059937 Jun 22 20:07:04.196577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1077/1749] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:04.400804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:07:04.401071 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:07:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:07:05.214216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-db256b61-eb35-4fdb-a2c6-40bde19e2862 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:05.268954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-db256b61-eb35-4fdb-a2c6-40bde19e2862 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062724 Jun 22 20:07:05.269521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 673/1750] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:06.286888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-285c653c-2653-4c76-9157-aac4e1fa25f1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e466790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:06.344986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-285c653c-2653-4c76-9157-aac4e1fa25f1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065378 Jun 22 20:07:06.345558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1078/1751] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:07.362816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d5ed967-1678-4e52-b492-4a90b9e06a56 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ed2040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:07.419373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d5ed967-1678-4e52-b492-4a90b9e06a56 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064157 Jun 22 20:07:07.419971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 674/1752] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:08.432756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-920b27aa-1726-4429-900e-257ad3d575a7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:08.483533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-920b27aa-1726-4429-900e-257ad3d575a7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055107 Jun 22 20:07:08.484363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1079/1753] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:09.495738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b26c8563-a73c-41cf-9c3a-6e87cf47b052 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d190d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:09.545045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b26c8563-a73c-41cf-9c3a-6e87cf47b052 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053432 Jun 22 20:07:09.545637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 675/1754] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:10.562450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c9e4a8f7-dbb2-425e-80ba-bf0aed493578 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463f70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:10.616481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c9e4a8f7-dbb2-425e-80ba-bf0aed493578 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060977 Jun 22 20:07:10.617028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1080/1755] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:11.633491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ba022ed2-34eb-4f83-a613-08f04eaced5e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7e1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:11.693003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ba022ed2-34eb-4f83-a613-08f04eaced5e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066822 Jun 22 20:07:11.693627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 676/1756] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:12.708125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-88e1fad8-5a2b-42f7-927b-4976b8a5d426 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:12.775524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-88e1fad8-5a2b-42f7-927b-4976b8a5d426 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.073496 Jun 22 20:07:12.776119 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1081/1757] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:13.792427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-97f3dd1b-5246-430c-91ab-06af9e7173ef tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5e3a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:13.847313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-97f3dd1b-5246-430c-91ab-06af9e7173ef tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062126 Jun 22 20:07:13.847887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 677/1758] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:14.863922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6abad1cb-68df-4fbd-ab50-09946c4838f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:14.916977 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6abad1cb-68df-4fbd-ab50-09946c4838f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059406 Jun 22 20:07:14.917537 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1082/1759] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:15.934702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-78f60a83-6b97-4afb-b1e6-fd387c0fb737 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e6ff70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:15.982934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-78f60a83-6b97-4afb-b1e6-fd387c0fb737 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055772 Jun 22 20:07:15.983716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 678/1760] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:16.996984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-16aca09d-7fe5-46cd-b2b4-95e366ea4486 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:17.044682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-16aca09d-7fe5-46cd-b2b4-95e366ea4486 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052308 Jun 22 20:07:17.045247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1083/1761] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:18.070231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c36485a2-a6fb-4829-9726-45b8c34e41f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe5700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:18.139447 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c36485a2-a6fb-4829-9726-45b8c34e41f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.080449 Jun 22 20:07:18.140041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 679/1762] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:19.157223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-75b5b514-ce5d-4bf4-b818-125e9d47e50a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e476820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:19.216829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-75b5b514-ce5d-4bf4-b818-125e9d47e50a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066855 Jun 22 20:07:19.217384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1084/1763] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:20.236066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9b9951ef-d603-4634-9d3f-1df38d47dbb3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:20.282984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9b9951ef-d603-4634-9d3f-1df38d47dbb3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055242 Jun 22 20:07:20.283575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 680/1764] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:21.299320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3493e67e-dbb9-479b-80bf-add51b749019 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:21.353502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3493e67e-dbb9-479b-80bf-add51b749019 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061268 Jun 22 20:07:21.354087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1085/1765] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:22.370942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c92b136f-966d-41d5-b3a9-26d22ba18089 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5e790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:22.424914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c92b136f-966d-41d5-b3a9-26d22ba18089 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061164 Jun 22 20:07:22.425477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 681/1766] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:22 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:23.443290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cb86b7b8-9129-4153-b40c-de9bdacf3628 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:23.501791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cb86b7b8-9129-4153-b40c-de9bdacf3628 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.066781 Jun 22 20:07:23.502437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1086/1767] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:24.515283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ed74e37f-db1e-4472-ab12-24c64571ab05 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19beaaf0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:24.566750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ed74e37f-db1e-4472-ab12-24c64571ab05 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055780 Jun 22 20:07:24.567481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 682/1768] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:25.584678 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5bc4a927-bde9-4aeb-96a9-87184e0eb815 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:25.642957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5bc4a927-bde9-4aeb-96a9-87184e0eb815 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065399 Jun 22 20:07:25.643521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1087/1769] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:26.660042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e5708ce6-509c-489c-9c3a-c2730a6fd21d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5e310>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:26.713300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e5708ce6-509c-489c-9c3a-c2730a6fd21d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060438 Jun 22 20:07:26.713873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 683/1770] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:27.730138 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2b647d5c-6a33-4e78-84d6-e78c77f3f808 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e455820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:27.780004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2b647d5c-6a33-4e78-84d6-e78c77f3f808 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057306 Jun 22 20:07:27.780595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1088/1771] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:28.643631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:07:28.644002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:07:28.797201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b2fa38f1-be0c-400e-9efc-f682e7a1742d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ed2820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:28.851000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b2fa38f1-be0c-400e-9efc-f682e7a1742d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061049 Jun 22 20:07:28.851569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 684/1772] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:29.865245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d10f42d4-d023-4861-b563-1e623b9154c5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e476b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:29.915784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d10f42d4-d023-4861-b563-1e623b9154c5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055906 Jun 22 20:07:29.916818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1089/1773] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:30.381354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:07:30.382222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:07:30.935437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-12ef3b37-bd2e-4da4-aa24-f02d927b8f16 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0f1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:30.989422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-12ef3b37-bd2e-4da4-aa24-f02d927b8f16 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062822 Jun 22 20:07:30.989991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 685/1774] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:32.002921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7f1f7bcc-b63d-43d1-a9fa-79edbc2ee2e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e455790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:32.050115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7f1f7bcc-b63d-43d1-a9fa-79edbc2ee2e5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051492 Jun 22 20:07:32.050675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1090/1775] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:33.067641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-78d98bb4-9c78-497a-86c0-51e83223c814 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe59d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:33.119707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-78d98bb4-9c78-497a-86c0-51e83223c814 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059319 Jun 22 20:07:33.120309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 686/1776] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:34.133351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5d7841ff-f1d8-46e1-a4c5-395693b36eb8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d4c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:34.180695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5d7841ff-f1d8-46e1-a4c5-395693b36eb8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051780 Jun 22 20:07:34.181265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1091/1777] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:35.198060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-99d04fdb-b34a-4486-a055-b6482084845e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:35.248199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-99d04fdb-b34a-4486-a055-b6482084845e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057176 Jun 22 20:07:35.248755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 687/1778] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:36.265485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b5ea45b9-352f-4c33-9dcd-347c6c8cd33e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4795e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:36.317113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b5ea45b9-352f-4c33-9dcd-347c6c8cd33e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058727 Jun 22 20:07:36.317679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1092/1779] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:37.334741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-231747df-b385-44e2-8f12-dc2078836c8f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf01f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:37.387362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-231747df-b385-44e2-8f12-dc2078836c8f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059997 Jun 22 20:07:37.387892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 688/1780] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:38.404919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d8898230-f371-400a-a6b1-78dbdd40cf48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:38.465443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d8898230-f371-400a-a6b1-78dbdd40cf48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063184 Jun 22 20:07:38.465443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1093/1781] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:39.476983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e0c81905-9d95-4d6c-8fb9-6d514c0ab084 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:39.530048 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e0c81905-9d95-4d6c-8fb9-6d514c0ab084 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058884 Jun 22 20:07:39.530845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 689/1782] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:40.550505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-52798bb9-a1d0-4293-800f-e4c36b8b4643 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4625e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:40.605782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-52798bb9-a1d0-4293-800f-e4c36b8b4643 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062639 Jun 22 20:07:40.606348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1094/1783] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:41.623729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90f2800c-52a6-4dae-a94d-f68856b1e462 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a05bb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:41.681325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90f2800c-52a6-4dae-a94d-f68856b1e462 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064851 Jun 22 20:07:41.681917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 690/1784] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:42.696312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-862fc78e-cd39-491e-ad2e-6a407c23dd47 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:42.744346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-862fc78e-cd39-491e-ad2e-6a407c23dd47 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.052654 Jun 22 20:07:42.744913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1095/1785] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:43.759630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-64f57504-a5ae-4b6e-9ee8-a3968e7819dc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0f820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:43.811525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-64f57504-a5ae-4b6e-9ee8-a3968e7819dc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057761 Jun 22 20:07:43.812084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 691/1786] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:44.829670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58c24849-6251-410a-88cd-caa6d356dc95 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4765e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:44.885915 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58c24849-6251-410a-88cd-caa6d356dc95 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063827 Jun 22 20:07:44.886452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1096/1787] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:45.900544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ee2c286-9e10-44f3-be04-07d8431f6520 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe5280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:45.967548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ee2c286-9e10-44f3-be04-07d8431f6520 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.072602 Jun 22 20:07:45.968201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 692/1788] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:46.985067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-175bc61d-0056-4ead-ba76-3195ba9b5710 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:47.040895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-175bc61d-0056-4ead-ba76-3195ba9b5710 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062953 Jun 22 20:07:47.041457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1097/1789] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:48.056345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4d51b1b3-b6e2-4bd0-a6d0-21875a45cda4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ceb5e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:48.111029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4d51b1b3-b6e2-4bd0-a6d0-21875a45cda4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059964 Jun 22 20:07:48.111812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 693/1790] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:49.126115 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4fadfb6e-bd03-4b8f-a095-88de2339d2f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e415940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:49.173598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4fadfb6e-bd03-4b8f-a095-88de2339d2f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.051982 Jun 22 20:07:49.174127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1098/1791] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:50.189249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e119bf85-4141-463a-8a60-02f844fc1124 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d190d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:50.240400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e119bf85-4141-463a-8a60-02f844fc1124 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057501 Jun 22 20:07:50.241157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 694/1792] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:51.258259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8e1428ac-7f6c-43a7-8884-55a5e7e0bf89 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4508b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:51.311485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8e1428ac-7f6c-43a7-8884-55a5e7e0bf89 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.060397 Jun 22 20:07:51.312041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1099/1793] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:52.328927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-24741836-063d-4b5d-9023-57b833333a5d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ceb5e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:52.384665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-24741836-063d-4b5d-9023-57b833333a5d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062806 Jun 22 20:07:52.385228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 695/1794] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:53.402199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1e13d189-743b-472c-9b12-0ef0dd5d50b5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4621f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:53.459730 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1e13d189-743b-472c-9b12-0ef0dd5d50b5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064712 Jun 22 20:07:53.460361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1100/1795] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:54.477327 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d1c66edf-bac7-438a-972c-ff9181931636 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe50d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:54.524871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d1c66edf-bac7-438a-972c-ff9181931636 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.054360 Jun 22 20:07:54.525595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 696/1796] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:55.540789 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7dc45ea5-5d74-4cae-b3b3-53a4673397d6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e415e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:55.591440 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7dc45ea5-5d74-4cae-b3b3-53a4673397d6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057105 Jun 22 20:07:55.591995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1101/1797] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:56.609030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ed585905-47ff-473d-8532-f36ef9b90a8f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e4e3a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:56.659664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ed585905-47ff-473d-8532-f36ef9b90a8f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057853 Jun 22 20:07:56.660260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 697/1798] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:57.677527 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-00183bdc-b607-4343-9c64-343d494ea1ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e455280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:57.733845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-00183bdc-b607-4343-9c64-343d494ea1ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.063672 Jun 22 20:07:57.734408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1102/1799] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:58.751488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e1fdf131-cc61-478b-8bb2-5b9a7e77e4ca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe50d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:58.806608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e1fdf131-cc61-478b-8bb2-5b9a7e77e4ca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.062536 Jun 22 20:07:58.807175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 698/1800] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:07:59.824647 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fb77b825-3a13-456d-b97c-12de0f250ad1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e52eee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:07:59.872007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fb77b825-3a13-456d-b97c-12de0f250ad1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055638 Jun 22 20:07:59.872650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1103/1801] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:07:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:00.889621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ec0d7a44-1e6f-4e34-8683-7f7c6c193759 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ceb5e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:00.944419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ec0d7a44-1e6f-4e34-8683-7f7c6c193759 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061962 Jun 22 20:08:00.944987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 699/1802] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:01.961949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9217b581-fc1e-4852-a286-2d4c2566a5f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e42a5e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:02.037528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9217b581-fc1e-4852-a286-2d4c2566a5f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.083006 Jun 22 20:08:02.038147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1104/1803] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:03.054959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-05497154-72e3-411c-9ef7-db787a6580db tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:03.104542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-05497154-72e3-411c-9ef7-db787a6580db tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.056745 Jun 22 20:08:03.105104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 700/1804] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:04.118560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2bcf0de7-26a7-4e7d-913e-d1960c57edbc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471550>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:04.168975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2bcf0de7-26a7-4e7d-913e-d1960c57edbc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.055403 Jun 22 20:08:04.169547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1105/1805] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:05.186648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4d69164e-ae6c-4a76-aac2-f4c16d6ca0cb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:05.237139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4d69164e-ae6c-4a76-aac2-f4c16d6ca0cb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057587 Jun 22 20:08:05.237724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 701/1806] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:06.254888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c8367d36-8a4a-48ab-aa13-66df064f035d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e479af0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:06.306905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c8367d36-8a4a-48ab-aa13-66df064f035d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059511 Jun 22 20:08:06.307469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1106/1807] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:07.324669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-294d3324-11df-43b2-a26d-ff9957ab9881 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe5670>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:07.377869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-294d3324-11df-43b2-a26d-ff9957ab9881 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.061173 Jun 22 20:08:07.378431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 702/1808] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:08.393246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2031e80c-b719-4816-8908-0dfe6afc9c70 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e462ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:08.440559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2031e80c-b719-4816-8908-0dfe6afc9c70 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053350 Jun 22 20:08:08.441103 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1107/1809] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:09.456419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bc4c5b5c-1648-41f3-be98-f87293aec952 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e7ba60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:09.507755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bc4c5b5c-1648-41f3-be98-f87293aec952 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057036 Jun 22 20:08:09.508356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 703/1810] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:10.523591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6a8dc369-a4d2-4145-90db-42f893bc6ca0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:10.574954 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6a8dc369-a4d2-4145-90db-42f893bc6ca0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.057065 Jun 22 20:08:10.575538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1108/1811] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:11.591702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2605256d-094a-4082-93c5-cc90154bb526 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe59d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:11.645072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2605256d-094a-4082-93c5-cc90154bb526 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.059937 Jun 22 20:08:11.645667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 704/1812] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:12.662528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d1cfd1ad-7779-4a6b-afba-2c0cc86aa702 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e415670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:12.721494 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d1cfd1ad-7779-4a6b-afba-2c0cc86aa702 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.065944 Jun 22 20:08:12.721991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1109/1813] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:13.739188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ed9d2b9-8860-44b0-9e3d-3e2d88217e2d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:13.796330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ed9d2b9-8860-44b0-9e3d-3e2d88217e2d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064521 Jun 22 20:08:13.796947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 705/1814] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:14.812006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f3d3c092-71bd-4df1-b616-37ac6ecd4183 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e45d3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:14.860657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f3d3c092-71bd-4df1-b616-37ac6ecd4183 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.054505 Jun 22 20:08:14.861225 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1110/1815] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:15.879166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9a8d76a9-22be-4228-b7d5-ff8a2bd85c48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a0459d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:15.942752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9a8d76a9-22be-4228-b7d5-ff8a2bd85c48 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.071112 Jun 22 20:08:15.943350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 706/1816] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:16.155172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:16.155693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:16.161723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:16.162159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:16.162916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:16.163362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:16.191416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:08:16.296229 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6fd71516-a721-4fe0-9c0d-0627758f92c2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 204 len: 0 microversion: 2.1 time: 0.144943 Jun 22 20:08:16.296835 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1111/1817] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:08:16 2022] DELETE /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:08:16.305035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:16.305759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:16.312303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:16.312744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:16.313494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:16.313944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:16.450779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:16.459312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b24816ff-a173-4cb3-b906-c91bf8ad855a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1559 microversion: 2.1 time: 0.158126 Jun 22 20:08:16.459885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 707/1818] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:16 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:16.960185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fbd6385d-04ed-4459-b2d1-ad2fb5e4b546 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:17.011238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fbd6385d-04ed-4459-b2d1-ad2fb5e4b546 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.058137 Jun 22 20:08:17.016189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1112/1819] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:17.477554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:17.478155 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:17.484998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:17.485453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:17.486180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:17.486627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:17.707868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:17.719043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ada80307-66c7-4787-b747-b5786d9785a3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1559 microversion: 2.1 time: 0.245441 Jun 22 20:08:17.719705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 708/1820] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:17 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:17.984126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-f47bc89c-0b1c-4142-a07c-2afbeb3bdd1c req-d6fdede7-0ee1-4b21-9631-cd2d7a3ceacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42be957b-1878-4d34-8da2-b0c98a90fd55", "name": "network-vif-deleted", "tag": "f21c0215-cc96-47c2-96a6-c5e1f3925a82"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:08:17.994097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f47bc89c-0b1c-4142-a07c-2afbeb3bdd1c req-d6fdede7-0ee1-4b21-9631-cd2d7a3ceacd service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:17.994529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-f47bc89c-0b1c-4142-a07c-2afbeb3bdd1c req-d6fdede7-0ee1-4b21-9631-cd2d7a3ceacd service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.005129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-f47bc89c-0b1c-4142-a07c-2afbeb3bdd1c req-d6fdede7-0ee1-4b21-9631-cd2d7a3ceacd service nova] Creating event network-vif-deleted:f21c0215-cc96-47c2-96a6-c5e1f3925a82 for instance 42be957b-1878-4d34-8da2-b0c98a90fd55 on hv-cinder-84721 Jun 22 20:08:18.010032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-f47bc89c-0b1c-4142-a07c-2afbeb3bdd1c req-d6fdede7-0ee1-4b21-9631-cd2d7a3ceacd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030338 Jun 22 20:08:18.010598 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1113/1821] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:18.023756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9525e969-a5d7-4f40-a1b2-b9a9c384b8af tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a045790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:18.073683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9525e969-a5d7-4f40-a1b2-b9a9c384b8af tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.053701 Jun 22 20:08:18.074261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 709/1822] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:18.327165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:18.327753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:18.334347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.334784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.335533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.336328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.361241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:08:18.442199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-688c3f6d-3c70-42d2-9e40-c6158ab6ae29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 204 len: 0 microversion: 2.1 time: 0.118905 Jun 22 20:08:18.442801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1114/1823] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:08:18 2022] DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:08:18.451112 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:18.451703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:18.457966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.458441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.459188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.459617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.594886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:18.603148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ca0801cd-456a-40c5-ac39-d76b7b65aecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1718 microversion: 2.1 time: 0.155780 Jun 22 20:08:18.603727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 710/1824] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:18.739159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:18.740268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:18.749689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.750394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.751562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:18.752284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:18.822245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:18.830432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa6bab45-d9b4-4ebb-9d4c-48acf7f5b50e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097547 Jun 22 20:08:18.830993 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1115/1825] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:18 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:19.090678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-03c65e42-d28d-47e9-8003-0747fd834f53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a0450d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:19.187255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-03c65e42-d28d-47e9-8003-0747fd834f53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.102931 Jun 22 20:08:19.187821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 711/1826] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:19.620571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:19.621169 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:19.627908 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:19.628388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:19.629154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:19.629578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:19.768791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:19.777146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9aa174c5-1087-4319-886c-3fc98ced6d26 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1718 microversion: 2.1 time: 0.160405 Jun 22 20:08:19.777758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1116/1827] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:19.848035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:19.848729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:19.855003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:19.855437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:19.856257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:19.856685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:19.935101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:19.943612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e04637e7-f5d7-44f3-8c65-1d8330830d12 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.100437 Jun 22 20:08:19.944205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 712/1828] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:20.201352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-289a288a-018c-412e-818b-a95f7ceb3c76 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46d790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:20.261282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-289a288a-018c-412e-818b-a95f7ceb3c76 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 0.064670 Jun 22 20:08:20.262024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1117/1829] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:20.271733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-77103aea-a015-46ab-af0c-d1220b3e3057 req-60bb9917-3f6e-44de-b453-dbca27a0e104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498198b2-0179-45ba-8753-15a2d61e7018", "name": "network-vif-deleted", "tag": "122a26bf-0569-4fc7-a032-d4665ea55d7d"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:08:20.281008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-77103aea-a015-46ab-af0c-d1220b3e3057 req-60bb9917-3f6e-44de-b453-dbca27a0e104 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:20.281749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-77103aea-a015-46ab-af0c-d1220b3e3057 req-60bb9917-3f6e-44de-b453-dbca27a0e104 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:20.293407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-77103aea-a015-46ab-af0c-d1220b3e3057 req-60bb9917-3f6e-44de-b453-dbca27a0e104 service nova] Creating event network-vif-deleted:122a26bf-0569-4fc7-a032-d4665ea55d7d for instance 498198b2-0179-45ba-8753-15a2d61e7018 on hv-cinder-84721 Jun 22 20:08:20.302177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-77103aea-a015-46ab-af0c-d1220b3e3057 req-60bb9917-3f6e-44de-b453-dbca27a0e104 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Jun 22 20:08:20.303262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 713/1830] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:08:20.795663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:20.796288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:20.802909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:20.803353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:20.804140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:20.804588 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:20.867583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:20.875665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3234d4ce-5c7c-432b-b72d-a26bd6ae1269 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.084604 Jun 22 20:08:20.876245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1118/1831] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:20.962115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:20.962862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:20.969653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:20.970096 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:20.970842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:20.971263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:21.042087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:21.050682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-12309614-64fc-4ab7-bba0-cbae6a32c783 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093515 Jun 22 20:08:21.051265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 714/1832] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:21.274937 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55d8585a-f64d-4c76-aa00-14d6bf04e4ae tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e46daf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:21.896423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:21.897680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:21.907854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:21.908662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:21.909924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:21.910743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:21.985520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:21.994162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6cf42d28-17c1-4580-bb30-655a6d3bfe20 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.104373 Jun 22 20:08:21.994729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 715/1833] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:22.071416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:22.072443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:22.082287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:22.083023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:22.084315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:22.085033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:22.150932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:22.159098 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4fc12204-5088-4417-afb5-0aaa8481bc94 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093688 Jun 22 20:08:22.159658 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 716/1834] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:22 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:23.014907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:23.015988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:23.026746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:23.027515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:23.028816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:23.029541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:23.092491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:23.103032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e9a49e5-a010-49d9-b27a-49e70fd518b3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094237 Jun 22 20:08:23.103761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 717/1835] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:23.184394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:23.185386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:23.195395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:23.196164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:23.197433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:23.198156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:23.262393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:23.270928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d2a6b159-c086-44d8-9099-b0f4b235c03c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092537 Jun 22 20:08:23.271380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 718/1836] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:23 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:24.125413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:24.126595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:24.136949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:24.137698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:24.138995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:24.139702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:24.206805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:24.215825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-45470285-4663-4cc0-b363-60f9fd1a3efd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096970 Jun 22 20:08:24.216425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 719/1837] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:24.292710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:24.294004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:24.305189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:24.305915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:24.307284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:24.308005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:24.383427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:24.392275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7ef2a748-380b-46e4-ab12-ce308b35382b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.108606 Jun 22 20:08:24.392854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 720/1838] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:24 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:25.237623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:25.238712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:25.249602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:25.250333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:25.251330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:25.251750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:25.316718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:25.325287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94c066db-e686-4d03-af00-d3eb19eb4e23 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094226 Jun 22 20:08:25.325844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 721/1839] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:25.414596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:25.415589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:25.424903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:25.425359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:25.426111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:25.426542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:25.492543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:25.500871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e793beba-50dd-45e4-b9dd-2fe3f276170b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093647 Jun 22 20:08:25.501485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 722/1840] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:25 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:26.344206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:26.344958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:26.355310 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:26.356047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:26.357399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:26.358035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:26.427273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:26.438874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7c5d7933-d52f-48f0-96d0-31a187931995 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099501 Jun 22 20:08:26.439467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 723/1841] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:26.520160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:26.520955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:26.529215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:26.529776 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:26.530728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:26.531284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:26.605976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:26.619109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-669a9b66-4c9b-459a-b266-40ac04800fa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.103787 Jun 22 20:08:26.619925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 724/1842] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:26 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:27.460093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:27.461682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:27.472639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:27.473407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:27.474754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:27.476182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:27.545667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:27.554181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e9445e12-af09-4540-a4ff-dced56998413 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100797 Jun 22 20:08:27.554763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 725/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:27 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:27.643642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:27.644293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:27.650673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:27.651117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:27.651888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:27.652348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:27.656533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:27.722855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:27.731543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d0e85dce-6f57-419b-aef0-c9511d8c7576 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094333 Jun 22 20:08:27.732126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 726/1844] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:27 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:28.575220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:28.576227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:28.584775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:28.585220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:28.586292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:28.586720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:28.656968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:28.666966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a6e2ba54-d0f4-4787-87c7-42310ce12a7c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098078 Jun 22 20:08:28.667689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 727/1845] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:28.749065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:28.749591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:28.756084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:28.756573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:28.757335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:28.757764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:28.828199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:28.837346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-60239e76-84a8-407a-879a-fbc6828c6de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092144 Jun 22 20:08:28.837914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 728/1846] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:28 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:29.688425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:29.689511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:29.696813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:29.697261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:29.698023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:29.698481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:29.763765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:29.772615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aa62415c-5da7-4ed1-b72e-a43a08f098c0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090821 Jun 22 20:08:29.773211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 729/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:29.860321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:29.861248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:29.867983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:29.868460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:29.869246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:29.869655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:29.930398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:29.938800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-485c490c-d2f6-4116-a6e3-884aaea86859 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086120 Jun 22 20:08:29.939385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 730/1848] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:29 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:30.793991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:30.795035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:30.801073 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:30.804660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:30.805143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:30.805873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:30.806477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:30.871503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:30.871694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:30.880208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f4682aaf-f6f7-46ca-952c-54ced244752c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092874 Jun 22 20:08:30.880786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 731/1849] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:30.958701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:30.959691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:30.970042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:30.970805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:30.972057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:30.972858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:31.035204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:31.043287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-940a0b7b-a24d-4204-9be4-ec856be88ebf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.090769 Jun 22 20:08:31.043855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 732/1850] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:30 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:31.901104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:31.902179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:31.912917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:31.913276 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:31.914024 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:31.914443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:31.981560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:31.990238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-34caae22-e04c-41aa-a3db-6637a974efa3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095646 Jun 22 20:08:31.990799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 733/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:32.063250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:32.064161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:32.076919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:32.077745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:32.079329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:32.080073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:32.146678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:32.159027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6836886c-a6a8-4aaa-b8cf-a853d9e9f5ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.101264 Jun 22 20:08:32.159785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 734/1852] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:32 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:33.010913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:33.012013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:33.022203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:33.022654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:33.023420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:33.023846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:33.093103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:33.101528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2d5b5e41-8068-46a0-bf18-e503f6b49eca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097196 Jun 22 20:08:33.102107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 735/1853] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:33 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:33.184697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:33.185700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:33.194612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:33.195051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:33.195821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:33.196293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:33.257595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:33.266142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fe666121-ef4d-4148-bb48-fb513cc58fea tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087628 Jun 22 20:08:33.266638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 736/1854] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:33 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:34.122762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:34.123590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:34.131996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:34.132589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:34.133524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:34.134058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:34.199565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:34.207885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b9403657-3f90-4692-8fa2-ecff7aaa1205 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091653 Jun 22 20:08:34.208487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 737/1855] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:34.286298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:34.287287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:34.297370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:34.298108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:34.299375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:34.300179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:34.364605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:34.372937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7111f30a-264b-4c24-8492-d14a09368941 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092779 Jun 22 20:08:34.373426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 738/1856] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:34 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:35.230650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:35.231804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:35.240018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:35.240489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:35.241240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:35.241694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:35.308319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:35.316800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e9bfa1c-da4e-417d-ba84-dc40e07ecb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093304 Jun 22 20:08:35.317364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 739/1857] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:35.393350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:35.394354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:35.404563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:35.405308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:35.406556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:35.407273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:35.476808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:35.485297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4ae2978c-8edc-40b5-b0f6-aed785384fe9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.098283 Jun 22 20:08:35.485863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 740/1858] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:35 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:36.338017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:36.339023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:36.346871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:36.347321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:36.348087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:36.348553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:36.413842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:36.422619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a811b51d-b257-4cf8-8241-7cb9095b3ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091613 Jun 22 20:08:36.423254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 741/1859] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:36.502880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:36.503494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:36.510131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:36.510577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:36.511336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:36.511764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:36.577292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:36.580778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:36.585898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cd6973f7-25ac-4a34-af27-6e6d08fe522f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086484 Jun 22 20:08:36.586469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 742/1860] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:36 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:37.443848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:37.444982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:37.454057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:37.454500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:37.455256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:37.455685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:37.520548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:37.529705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0499cba1-6881-4714-b189-b77c49a1d19a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092828 Jun 22 20:08:37.530285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 743/1861] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:37.603025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:37.603628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:37.610358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:37.610803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:37.611558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:37.611985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:37.682409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:37.690616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1b7bbecd-58a6-4d2d-ab8f-4958ee8cdd1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091424 Jun 22 20:08:37.691269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 744/1862] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:37 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:38.551123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:38.552170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:38.562472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:38.565876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:38.566636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:38.567063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:38.629566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:38.638323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5fd1aa0b-efae-434c-87ea-2910702c768d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093316 Jun 22 20:08:38.638899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 745/1863] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:38.708052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:38.708706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:38.715115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:38.715564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:38.716360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:38.716792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:38.778245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:38.786690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c49d3a35-6470-4f67-9599-d8885afbe9a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082373 Jun 22 20:08:38.787555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 746/1864] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:38 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:39.659405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:39.660485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:39.671097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:39.671541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:39.672338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:39.672776 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:39.746753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:39.755315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d7e14702-a195-4331-a31c-7445ce7b1320 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.102358 Jun 22 20:08:39.755882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 747/1865] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:39 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:39.807381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:39.808534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:39.819023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:39.819766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:39.821087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:39.821807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:39.887381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:39.895659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ace94d63-281c-4ea8-9c37-3bcd75e9798c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094529 Jun 22 20:08:39.896245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 748/1866] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:39 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:40.775755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:40.776920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:40.785348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:40.785795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:40.786540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:40.786964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:40.851213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:40.859399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-834a02aa-86cc-40f9-a9a3-6d42f93c4aca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090286 Jun 22 20:08:40.859959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 749/1867] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:40.912626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:40.913228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:40.919767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:40.920249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:40.921007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:40.921438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:40.987999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:40.996133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dbfd19c8-f086-4e9f-9a42-4756d5ea8c9b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087189 Jun 22 20:08:40.996751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 750/1868] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:40 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:41.880417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:41.881452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:41.891781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:41.892244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:41.892994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:41.893438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:41.971558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:41.979737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f18f974f-7b6a-4ccf-a0e2-607a0db01a06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.105836 Jun 22 20:08:41.980332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 751/1869] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:42.012600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:42.013187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:42.019408 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:42.019950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:42.020764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:42.021195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:42.091733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:42.103726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-83140f9d-63bf-4a98-b9f6-b3967f3c27ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094419 Jun 22 20:08:42.104575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 752/1870] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:42 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:43.000612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:43.001457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:43.009748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:43.010309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:43.011253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:43.011790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:43.084151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:43.093108 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-58e8206d-f9ba-4885-b6e0-35aca9c658c8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099122 Jun 22 20:08:43.093684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 753/1871] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:43.121608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:43.122255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:43.128617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:43.129063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:43.129827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:43.130264 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:43.197297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:43.205684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-49d46e3f-0418-41f3-8dbd-d4c3459d9b04 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087801 Jun 22 20:08:43.206222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 754/1872] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:43 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:44.120026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:44.121113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:44.131888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:44.132689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:44.133927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:44.134630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:44.207555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:44.216675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-160e6d35-2054-429c-83f4-5ae2b1574ed2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.103060 Jun 22 20:08:44.217496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 755/1873] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:44 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:44.224693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:44.226087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:44.235189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:44.235637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:44.236443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:44.236882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:44.316846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:44.329474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7753aa1b-b430-409e-891b-19b7d878804c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.110374 Jun 22 20:08:44.330044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 756/1874] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:44 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:45.241796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:45.242892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:45.252546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:45.252989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:45.253744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:45.254174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:45.326228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:45.334740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10b72213-dc48-4bb8-bf8c-d381daee8818 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099426 Jun 22 20:08:45.335307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 757/1875] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:45.346779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:45.347401 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:45.350330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:45.354263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:45.354707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:45.355467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:45.355893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:45.418963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:45.427323 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cd2b3000-76c1-4847-b2d9-2194f7df3c65 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084506 Jun 22 20:08:45.427878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 758/1876] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:45 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:46.356333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:46.357356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:46.366206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:46.366650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:46.367416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:46.367846 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:46.386190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:46.434427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:46.442729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ccb7141d-28ff-4077-911e-290b6ed6850b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093514 Jun 22 20:08:46.443293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 759/1877] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:46.447687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:46.448432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:46.454225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:46.454680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:46.455438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:46.455871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:46.520669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:46.528858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2291c003-04ed-4fc8-b5f1-2657b5345946 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084612 Jun 22 20:08:46.529444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 760/1878] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:46 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:46.825744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:08:46.825954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:08:47.464222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:47.465242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:47.475081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:47.475523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:47.476299 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:47.476753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:47.538990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:47.547221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-729a9af7-9fac-40f0-821c-eb1bcd636992 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.089936 Jun 22 20:08:47.547786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 761/1879] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:47.552064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:47.552669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:47.558212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:47.558649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:47.559395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:47.559821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:47.620302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:47.628805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3b2e358d-9d1f-4beb-b936-69e232a87b2c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.079926 Jun 22 20:08:47.629371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 762/1880] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:47 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:48.568207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:48.569243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:48.580369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:48.581121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:48.582407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:48.582844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:48.648058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:48.659661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-14618674-c631-46a2-9aab-6c2b03ec1cd9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097833 Jun 22 20:08:48.660479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 763/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:48 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:48.665184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:48.665808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:48.672493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:48.673129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:48.674292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:48.674958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:48.735368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:48.743615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4bdd8ca2-be54-4c1b-90ef-d3f3f24a233e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082226 Jun 22 20:08:48.744203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 764/1882] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:48 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:49.681255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:49.682312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:49.692910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:49.693362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:49.694122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:49.694553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:49.758005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:49.770899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a9ece4ba-3448-4451-b197-cd2e4b0fc5f6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095839 Jun 22 20:08:49.771811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 765/1883] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:49.776122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:49.776728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:49.782840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:49.783476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:49.784606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:49.785330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:49.846656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:49.855501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-55d54d3c-fb68-46f4-af12-2d5113d91463 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082613 Jun 22 20:08:49.856092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 766/1884] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:49 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:50.793400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:50.794420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:50.805933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:50.806616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:50.807451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:50.807881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:50.874978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:50.883569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2ac9414f-ea5e-4863-8bcd-d7c9f60e901e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097926 Jun 22 20:08:50.884129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 767/1885] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:50 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:50.888467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:50.889054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:50.894612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:50.895064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:50.895840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:50.896308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:50.969386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:50.981282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a57153c1-7774-4b39-970b-b6eda07702fa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.095882 Jun 22 20:08:50.982018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 768/1886] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:50 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:51.903955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:51.905202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:51.914264 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:51.914707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:51.915462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:51.915889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:51.986287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:51.994916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0e4e6058-4d05-491c-9ca3-f0a53d6e73d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097640 Jun 22 20:08:51.995484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 769/1887] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:52.000621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:52.001218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:52.007505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:52.007950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:52.008745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:52.009176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:52.082646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:52.091255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3ed13eba-d9a8-4921-a9b5-86b787d56161 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094058 Jun 22 20:08:52.091837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 770/1888] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:51 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:08:53.015670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:53.016811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:53.025213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:53.025657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:53.026421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:53.026845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:53.093445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:53.105638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-263c1177-8b94-4af5-ab84-77c935b2bafc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095985 Jun 22 20:08:53.106382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 771/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:53 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:53.110943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:53.111576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:53.117988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:53.118440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:53.119223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:53.119633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:53.198413 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:53.206728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7138d94c-0da9-4b5f-b66c-2288d7a82210 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.099411 Jun 22 20:08:53.207312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 772/1890] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:53 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:54.126979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:54.128169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:54.135962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:54.136438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:54.137200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:54.137618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:54.201986 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:54.210752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f854f450-b2e7-48be-94e8-0e5ba5221525 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090056 Jun 22 20:08:54.211343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 773/1891] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:54.224374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:54.224984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:54.231038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:54.231479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:54.232271 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:54.232707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:54.299290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:54.307832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ca15d7f1-fe89-48cd-8837-ee8ccb982a6b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087352 Jun 22 20:08:54.308414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 774/1892] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:54 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:54.779080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:08:54.779406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:08:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:08:55.231147 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:55.232285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:55.241832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:55.242275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:55.243018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:55.243445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:55.308288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:55.316984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a151c772-c1ad-4b09-98b7-fd8561c26f0d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092241 Jun 22 20:08:55.317543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 775/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:55.324397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:55.325118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:55.331548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:55.332000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:55.332858 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:55.333331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:55.338247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:08:55.395964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:55.404140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-75b66707-bf65-4c69-86a5-3fc25ffed38f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083284 Jun 22 20:08:55.404744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 776/1894] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:55 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:55.982212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:08:55.983099 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:08:56.338175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:56.339054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:56.350220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:56.350641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:56.351403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:56.351834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:56.413348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:56.421706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6acce439-1e53-48f0-b7fd-472ce4337bf8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090622 Jun 22 20:08:56.422272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 777/1895] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:56 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:56.426534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:56.427123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:56.432791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:56.433227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:56.433974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:56.434398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:56.495899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:56.507259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a1c4caf3-496b-4b83-b9e6-90df23b5ab33 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083797 Jun 22 20:08:56.508139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 778/1896] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:56 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:57.442560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:57.443542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:57.454382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:57.455128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:57.456415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:57.457127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:57.522917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:57.534765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6e7994a0-2202-4174-90fd-6f88515cc8bd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098746 Jun 22 20:08:57.535329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 779/1897] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:57.539945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:57.540570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:57.546830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:57.547274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:57.548029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:57.548462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:57.610449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:57.618548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-338cdc95-34d6-4784-955e-bf1c5bae5bd2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082300 Jun 22 20:08:57.619109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 780/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:57 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:58.557523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:58.559870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:58.571085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:58.571528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:58.572324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:58.572746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:58.639814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:58.648343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-364e8a2e-e28d-490b-a016-1389ab2b4d13 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099025 Jun 22 20:08:58.648952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 781/1899] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:58 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:58.653309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:58.654180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:58.660590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:58.661332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:58.662850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:58.663358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:58.726887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:58.735237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9fe591c1-fe96-43b6-a185-66667713a591 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085275 Jun 22 20:08:58.736058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 782/1900] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:58 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:59.669445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:59.670514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:59.680489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:59.680933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:59.681687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:59.682114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:59.746470 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:59.754695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e42c58a-fb73-4e0d-bda4-dd44e78067d9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091873 Jun 22 20:08:59.755267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 783/1901] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:08:59.759701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:08:59.760330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:08:59.769003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:59.769449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:59.770201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:08:59.770628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:08:59.830557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:08:59.839115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f1f5af1d-96df-4b3f-b623-d9261dbbfd20 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082916 Jun 22 20:08:59.839678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 784/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:08:59 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:00.775915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:00.777142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:00.787953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:00.788784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:00.789564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:00.789994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:00.852842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:00.860971 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6d77c182-b40a-4406-8765-695665a538c2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091727 Jun 22 20:09:00.861546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 785/1903] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:00.865923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:00.866541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:00.872637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:00.873069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:00.873849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:00.874270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:00.933121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:00.940862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e58aa28-35d6-4d96-811e-f9674eea7c3e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.078414 Jun 22 20:09:00.941422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 786/1904] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:00 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:01.882198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:01.883229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:01.894509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:01.895233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:01.896527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:01.897234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:01.964422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:01.976592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7ee35592-8c08-4c67-ab07-c634d567b89f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100647 Jun 22 20:09:01.977360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 787/1905] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:01.983904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:01.984830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:01.992982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:01.993414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:01.994166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:01.994593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:02.057285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:02.069575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-579733be-d90a-4e4f-a598-1c422271dc8d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.090873 Jun 22 20:09:02.070279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 788/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:01 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:02.999592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:03.000370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:03.009450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:03.009876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:03.010633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:03.011058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:03.083787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:03.092353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fef7dfe0-a7cc-4380-8890-6ef94235bb5b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096865 Jun 22 20:09:03.092921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 789/1907] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:02 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:03.097234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:03.097822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:03.103480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:03.103913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:03.104687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:03.105110 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:03.164540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:03.172979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1ae34c8f-fcdf-4486-9779-b99aadcd5904 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.079151 Jun 22 20:09:03.173534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 790/1908] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:03 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:04.113598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:04.114733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:04.122954 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:04.123405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:04.124159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:04.124612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:04.193499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:04.202130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0df44558-6212-4fad-9ae4-0c71a4ab389e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095356 Jun 22 20:09:04.202703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 791/1909] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:04.207075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:04.207667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:04.214153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:04.214599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:04.215349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:04.215775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:04.284789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:04.288210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:09:04.293427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-256bd09c-1df4-46e1-8858-23a4edebc98c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089799 Jun 22 20:09:04.293964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 792/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:04 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:05.223510 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:05.224688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:05.232997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:05.233445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:05.234203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:05.234660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:05.294936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:05.303056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-024bd6f8-f651-458d-a78e-d06041835ed5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.086612 Jun 22 20:09:05.303627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 793/1911] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:05.310271 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:05.310868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:05.316670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:05.317124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:05.317878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:05.318307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:05.378626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:05.386873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1d031aec-3964-4453-ae46-b36e03732198 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080889 Jun 22 20:09:05.387468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 794/1912] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:05 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:09:06.323405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:06.324503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:06.335751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:06.336567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:06.337792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:06.338635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:06.411120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:06.419783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f7884cad-828d-431b-8396-4655c342dfa9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.102820 Jun 22 20:09:06.420432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 795/1913] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:06.424973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:06.425565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:06.431187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:06.431633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:06.432459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:06.432899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:06.498883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:06.511140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-76f55660-af17-40e7-931f-072ad9121ed2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089437 Jun 22 20:09:06.511849 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 796/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:06 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:07.441103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:07.442208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:07.451522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:07.451965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:07.452749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:07.453174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:07.524128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:07.532627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9b1a02eb-c63b-4143-9d8e-f15224f13d30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098248 Jun 22 20:09:07.533196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 797/1915] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:07.537585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:07.538169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:07.544061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:07.544531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:07.545277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:07.545703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:07.611737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:07.619906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a59779b8-6aaf-4f4a-a832-e7a84f702214 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085773 Jun 22 20:09:07.620504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 798/1916] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:07 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:08.552995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:08.554066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:08.568560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:08.568980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:08.569771 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:08.570198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:08.637589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:08.647293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ec0ebde1-9469-43d4-af45-7a48c906e5f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100970 Jun 22 20:09:08.647859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 799/1917] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:08 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:08.652412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:08.653025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:08.658844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:08.659304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:08.660033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:08.660489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:08.723354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:08.731666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-74aedf0d-e750-4388-9765-1516872e1b3c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082753 Jun 22 20:09:08.732158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 800/1918] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:08 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:09.669245 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:09.670095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:09.678961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:09.679562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:09.680638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:09.681195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:09.747449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:09.756069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-04bffc93-1287-48ce-b512-84d869807e6a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093753 Jun 22 20:09:09.756670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 801/1919] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:09.760943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:09.761581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:09.767253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:09.767702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:09.768480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:09.768913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:09.840320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:09.849426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0ce8cd53-3544-40fb-be81-1409601a7eda tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091775 Jun 22 20:09:09.850021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 802/1920] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:09 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:10.777097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:10.777800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:10.784683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:10.785130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:10.785896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:10.786346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:10.859143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:10.867647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-338f2970-7c96-4f00-877b-7fb2a18dca82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097085 Jun 22 20:09:10.868215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 803/1921] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:10.872747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:10.873346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:10.879340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:10.879790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:10.880581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:10.881017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:10.948736 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:10.957023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-06dd3bbb-574e-4709-a310-e708ef519ef3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087847 Jun 22 20:09:10.957589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 804/1922] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:10 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:11.887555 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:11.888258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:11.895118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:11.895573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:11.896361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:11.896797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:11.971259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:11.979549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90921610-708c-43a6-ae8f-2d51be9b7e7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097610 Jun 22 20:09:11.980150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 805/1923] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:11.984516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:11.985104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:11.990990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:11.991432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:11.992214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:11.992638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:12.059062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:12.067174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e6244440-d450-4c38-9d47-431099d42cac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086063 Jun 22 20:09:12.067722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 806/1924] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:11 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:13.000404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:13.001517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:13.012013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:13.012494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:13.013255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:13.013683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:13.083116 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:13.091970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-13df270c-f56e-413c-840f-37f2be8cb254 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098076 Jun 22 20:09:13.092570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 807/1925] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:13.096890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:13.097478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:13.100035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:09:13.103707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:13.104229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:13.105013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:13.105438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:13.165749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:13.174516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-add8f20c-3aac-4672-a33a-47bc52329502 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080995 Jun 22 20:09:13.175105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 808/1926] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:13 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:14.110253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:14.111007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:14.117920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:14.118364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:14.119132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:14.119562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:14.137997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:09:14.185632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:14.197439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-492e123b-3925-4049-9a05-13ba6fa0ba2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091327 Jun 22 20:09:14.198015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 809/1927] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:14.202622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:14.203416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:14.209407 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:14.209845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:14.211001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:14.211490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:14.276171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:14.287201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-76b70bd8-688d-4513-af55-a9536e2c6c87 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087867 Jun 22 20:09:14.287973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 810/1928] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:14 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:15.218913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:15.219989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:15.230699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:15.231390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:15.232135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:15.232588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:15.296345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:15.304672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4c93be81-d0b5-4d9e-b0b6-a1309cb7a742 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092327 Jun 22 20:09:15.305252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 811/1929] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:15.309855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:15.310491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:15.316498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:15.316951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:15.317705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:15.318137 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:15.379325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:15.388142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6247a70b-7f45-429e-ba83-5c52a8a0a3f2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081893 Jun 22 20:09:15.388740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 812/1930] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:15 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:16.325719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:16.326672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:16.337757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:16.338488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:16.339720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:16.340474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:16.406431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:16.414850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-800c996c-ec12-4f6e-beda-78096c3b4ec6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095667 Jun 22 20:09:16.415460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 813/1931] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:16.419875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:16.420521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:16.426451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:16.426899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:16.427657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:16.428090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:16.492682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:16.501201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b78c68e0-de52-40de-8967-482ef6f08ddf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084778 Jun 22 20:09:16.501785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 814/1932] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:16 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:17.435630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:17.436720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:17.444661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:17.445195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:17.446088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:17.446599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:17.514557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:17.523192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-40855c07-1072-48db-b7a6-fb98ed57889b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094213 Jun 22 20:09:17.523775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 815/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:17.528074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:17.528720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:17.534430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:17.534874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:17.535631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:17.536058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:17.601735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:17.611917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-84aa2cd4-b6af-425a-a71b-120fd3acfea8 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087217 Jun 22 20:09:17.612556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 816/1934] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:17 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:18.543152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:18.543828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:18.551249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:18.551697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:18.552490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:18.552915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:18.615630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:18.624266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72d5f552-1c64-495b-9f28-bcafe78deecc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.087399 Jun 22 20:09:18.624837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 817/1935] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:18.629181 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:18.629773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:18.635417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:18.635863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:18.636645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:18.637074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:18.697053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:18.706575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ef59b6b5-abcd-4419-a6a8-d88b6fe8eddb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080802 Jun 22 20:09:18.707284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 818/1936] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:18 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:19.644635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:19.645829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:19.655988 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:19.656458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:19.657209 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:19.657632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:19.724718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:19.735333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4224db28-9898-4ced-8704-ee6fe67f409e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097171 Jun 22 20:09:19.735773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 819/1937] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:19.740027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:19.740641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:19.746142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:19.746589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:19.747324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:19.747746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:19.809252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:19.817637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aa88b282-a561-463d-96f7-373ef477315d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080892 Jun 22 20:09:19.818213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 820/1938] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:20.756172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:20.757402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:20.767079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:20.767533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:20.768338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:20.768765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:20.830429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:20.839102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5204e55c-04df-4199-b5a2-8bb0c408597c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.089599 Jun 22 20:09:20.839664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 821/1939] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:20.844078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:20.844693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:09:20.850445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:20.850932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:20.851678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:09:20.852123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:09:20.915445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:09:20.923624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4a834160-ec74-400f-9570-f01b79804be6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083007 Jun 22 20:09:20.924192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 822/1940] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:09:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:09:21.309983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d4dab448-b70c-4715-91bf-cde8df57d360 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e481dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:09:30.847734 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=28 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:09:30.919591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=80 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:18.305721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55d8585a-f64d-4c76-aa00-14d6bf04e4ae tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 117.034724 Jun 22 20:10:18.306500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1119/1941] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:08:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 117036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:10:18.311631 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:18.312278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:18.318599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:18.319018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:18.319814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:18.320260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:18.479070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d4dab448-b70c-4715-91bf-cde8df57d360 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 57.175685 Jun 22 20:10:18.479912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 823/1942] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:09:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:10:18.484754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:18.485596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:18.493940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:18.494389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:18.495317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:18.495753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:18.545095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:18.553194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-31a2f562-c209-42ea-8a39-3218a4d9b4bc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.245801 Jun 22 20:10:18.553756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1120/1943] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:18.567372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:18.575554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0bcf1b71-d57e-4aa5-95e3-e282bf705a67 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094661 Jun 22 20:10:18.576139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 824/1944] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:18 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:19.490940 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-56e67fd9-5b8f-4ffc-8adb-e33dcbea7228 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:19.574241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:19.575172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:19.583340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:19.583869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:19.585184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:19.585695 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:19.653126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:19.665976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e9a3543a-76fd-4911-b116-d3e4653e6b29 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098001 Jun 22 20:10:19.666748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 825/1945] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:19.671266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:19.671821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:19.677828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:19.678283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:19.679040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:19.679464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:19.748337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:19.756889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0b89019d-9a56-4f18-b2cf-4a153fceb147 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089187 Jun 22 20:10:19.757459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 826/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:20.461598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.462233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.468551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.468996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.469770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.470203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.484058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 HTTP/1.1 Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:10:20.485829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.487391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'c37a123d-0a0a-4dc6-963b-319f220a7be5'} Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:10:20.491912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.495331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.498553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:10:20.498553 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b30f3e0a-d0cd-4fca-ae6d-bdf6d0e40b6c tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 404 len: 111 microversion: 2.1 time: 0.030106 Jun 22 20:10:20.498879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-56e67fd9-5b8f-4ffc-8adb-e33dcbea7228 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 1.000933 Jun 22 20:10:20.499399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 827/1947] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:10:20 2022] DELETE /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 20:10:20.499568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1121/1948] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:10:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:10:20.499726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.499726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: c37a123d-0a0a-4dc6-963b-319f220a7be5] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.502753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.503221 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.503977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.504449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.519912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 HTTP/1.1 Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:10:20.521430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.523167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'c37a123d-0a0a-4dc6-963b-319f220a7be5'} Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:10:20.524215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. Jun 22 20:10:20.525780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.527590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance c37a123d-0a0a-4dc6-963b-319f220a7be5 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:10:20.527590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-454002bb-f7b1-4520-af8c-e92357b01ff4 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jun 22 20:10:20.527590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 828/1949] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:20 2022] GET /compute/v2.1/servers/c37a123d-0a0a-4dc6-963b-319f220a7be5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:10:20.532051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.532578 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.539004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.539453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.540247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.540683 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.553244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd HTTP/1.1 Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:10:20.554868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.556568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '9b876bf3-5d64-46b3-a37f-8a408ad328dd'} Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:10:20.557573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.559226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.560897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:10:20.560897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-73fcbb64-077b-4153-bded-212f0a741f67 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 404 len: 111 microversion: 2.1 time: 0.028711 Jun 22 20:10:20.560897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1122/1950] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:10:20 2022] DELETE /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:10:20.564661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.565267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: 9b876bf3-5d64-46b3-a37f-8a408ad328dd] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.571587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.572057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.572837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.573263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.587506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd HTTP/1.1 Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:10:20.589033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.590877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '9b876bf3-5d64-46b3-a37f-8a408ad328dd'} Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:10:20.591819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. Jun 22 20:10:20.593302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:10:20.594530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance 9b876bf3-5d64-46b3-a37f-8a408ad328dd could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:10:20.594530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4f0e54df-732f-418c-a83d-11d753896e3d tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd" status: 404 len: 111 microversion: 2.1 time: 0.029506 Jun 22 20:10:20.594530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 829/1951] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:20 2022] GET /compute/v2.1/servers/9b876bf3-5d64-46b3-a37f-8a408ad328dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:10:20.683796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.684473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.697502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.698216 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.699864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.700662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.769338 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:20.773977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:20.774513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:20.777655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-eab8d0fa-8653-45fa-b66b-563173979791 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097900 Jun 22 20:10:20.778282 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1123/1952] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:20.781094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.781530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.782274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:20.782698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:20.843727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:20.852634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94f45025-29ea-4381-9ec9-b190621fdd2f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082645 Jun 22 20:10:20.853205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 830/1953] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:21.502418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8352bf33-0cee-4872-b998-fd45e8532d53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:21.798982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:21.799830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:21.810783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:21.811523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:21.812823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:21.813544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:21.882843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:21.892796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c069e68e-19b7-4363-870f-dff961601e06 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100549 Jun 22 20:10:21.893369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 831/1954] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:21.897803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:21.898404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:21.904419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:21.904870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:21.905632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:21.906063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:21.967590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:21.976070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c4bcd43f-dbd0-4aeb-bb05-56c8803e35cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081771 Jun 22 20:10:21.976675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 832/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:21 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:22.913816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:22.914938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:22.925634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:22.926362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:22.927598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:22.928350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:22.993168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:23.001588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2f88085b-1a10-41c7-82a0-85ed2a301e73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094336 Jun 22 20:10:23.002143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 833/1956] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:23.006705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:23.007314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:23.012920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:23.013353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:23.014095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:23.014515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:23.079662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:23.087834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4086b016-2712-4242-af1b-08a2dd0497b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084779 Jun 22 20:10:23.088418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 834/1957] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:23 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:24.022749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:24.023995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:24.034787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:24.035530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:24.036851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:24.037581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:24.106324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:24.114573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-063f9f49-086f-460d-999e-1e4e3a224253 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098380 Jun 22 20:10:24.115152 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 835/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:24.119490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:24.120126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:24.128293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:24.128685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:24.130062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:24.130505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:24.207438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:24.216302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6b0d05d5-5bb9-4b40-89da-634f04a44bdc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.100076 Jun 22 20:10:24.219868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 836/1959] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:24 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:24.414595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:10:24.415389 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:10:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:10:25.135917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:25.136931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:25.147943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:25.148874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:25.150132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:25.150861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:25.216952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:25.225345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2d1a2d5f-b303-4813-86d9-4948ce377450 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095958 Jun 22 20:10:25.225923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 837/1960] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:25.232652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:25.233252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:25.239432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:25.239876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:25.240693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:25.241131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:25.303141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:25.313202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c831421f-2212-4d8e-9d9c-d970b9d1d1a5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084032 Jun 22 20:10:25.313749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 838/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:25 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:26.246614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:26.247741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:26.259847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:26.260662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:26.261951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:26.262656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:26.328079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:26.340498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b2a794c5-30e8-420c-ac5a-4d492f9fb19e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100135 Jun 22 20:10:26.341198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 839/1962] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:26.345544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:26.346132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:26.352889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:26.353355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:26.354376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:26.354944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:26.416353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:26.424565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-07c0eb01-0e73-48af-b951-c2a270fdd0aa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082415 Jun 22 20:10:26.425114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 840/1963] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:26 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:27.361869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:27.362999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:27.373753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:27.374252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:27.375011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:27.375444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:27.446539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:27.454932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1fb5bdcd-d22f-4f20-bc7f-40c19f730b3f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099807 Jun 22 20:10:27.455499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 841/1964] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:27 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:27.494919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:27.495519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:27.502800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:27.503235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:27.504034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:27.504509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:27.525324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:27.568450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:27.576578 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bcfb2be0-d7c2-4dd2-80bc-0636dd47bafc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085458 Jun 22 20:10:27.577146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 842/1965] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:27 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:28.480621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:28.481572 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:28.488903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:28.489345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:28.490093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:28.490516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:28.558885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:28.567434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-84fd0db7-c34b-4c55-88f5-6a1a84491815 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094422 Jun 22 20:10:28.568003 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 843/1966] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:28 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:10:28.593838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:28.594432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:28.600269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:28.600704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:28.601442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:28.601857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:28.662982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:28.671445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f0d338f5-b244-42fa-85b2-b3cccd1cb3b1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081188 Jun 22 20:10:28.672001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 844/1967] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:28 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:10:29.588917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:29.590030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:29.601143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:29.601897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:29.603153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:29.603871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:29.668441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:29.676952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7d9bf994-9366-4d28-95e3-a94ba2c6f17b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094887 Jun 22 20:10:29.677523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 845/1968] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:29.688036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:29.688700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:29.694838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:29.695263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:29.696038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:29.696504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:29.757452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:29.766012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6d960f52-69f2-43d6-ae45-6705ddfac2a6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081601 Jun 22 20:10:29.766600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 846/1969] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:29 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:30.690751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:30.698626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:30.699627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:30.711211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:30.711958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:30.713277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:30.713994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:30.773506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=14 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:30.779583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:30.788317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8ddcda7e-d915-4e93-916b-30d038848330 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096627 Jun 22 20:10:30.788928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 847/1970] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:30.793322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:30.793922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:30.799919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:30.800404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:30.801166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:30.801604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:30.867386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:30.878685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7e93cae7-9a0e-4a6f-a733-41df03009a92 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.088814 Jun 22 20:10:30.879262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 848/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:30 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:31.809376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:31.810429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:31.821324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:31.822069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:31.823333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:31.824049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:31.892013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:31.905111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a15d47c4-329b-4754-8982-bc76753e6b82 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.102098 Jun 22 20:10:31.905915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 849/1972] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:31.912833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:31.913728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:31.922384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:31.922836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:31.923593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:31.924023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:31.996169 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:32.004679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fbf3bef2-b7e1-4e46-85ee-9cb1bd7140a2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097663 Jun 22 20:10:32.005258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 850/1973] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:31 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:32.931196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:32.932354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:32.940884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:32.941355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:32.942120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:32.942554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:33.006175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:33.014648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-105fc23b-6387-4639-b6cc-65deee36f171 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090075 Jun 22 20:10:33.015526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 851/1974] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:32 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:33.021179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:33.021772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:33.029829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:33.030386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:33.031240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:33.031663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:33.092816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:33.100916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e470f9a3-baf7-4fab-9868-424c10f81728 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083331 Jun 22 20:10:33.101476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 852/1975] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:33 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:34.035646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:34.036781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:34.047276 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:34.047727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:34.048497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:34.048963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:34.110105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:34.118347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-40b0f665-12c8-44c6-9766-3b1125ad6976 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.089257 Jun 22 20:10:34.118911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 853/1976] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:34.123397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:34.123995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:34.129703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:34.130150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:34.130913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:34.131343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:34.192495 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:34.200714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f87ea6fc-11bb-4653-b51e-1a006ed950fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080813 Jun 22 20:10:34.201283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 854/1977] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:34 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:35.138833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:35.139823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:35.150709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:35.151456 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:35.152745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:35.153485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:35.225699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:35.234086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5933c340-a700-4bc3-898d-de259a63980e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.101799 Jun 22 20:10:35.234647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 855/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:35.238921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:35.239536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:35.245337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:35.245810 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:35.246596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:35.247027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:35.322380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:35.330420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f156ed4a-d3c5-4424-b6d3-a252970ce31d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094850 Jun 22 20:10:35.331022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 856/1979] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:35 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:36.255443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:36.256606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:36.266739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:36.267194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:36.267962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:36.268428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:36.339645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:36.347940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-46a460b6-ad94-4b6d-a5be-0fae8f620f9d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099158 Jun 22 20:10:36.348551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 857/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:36.353059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:36.353659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:36.359648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:36.360113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:36.360879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:36.361311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:36.423890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:36.431970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b42ea84a-46f0-4cdf-9715-61abfb3aa6e9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082375 Jun 22 20:10:36.432579 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 858/1981] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:36 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:37.369676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:37.370653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:37.378376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:37.378822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:37.379570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:37.379991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:37.383974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:37.448387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:37.460679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c2089532-921b-4d73-b8da-56bec025aef7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097800 Jun 22 20:10:37.461244 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 859/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:37.465961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:37.466560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:37.472929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:37.473388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:37.474154 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:37.474584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:37.535525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:37.544044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-291702aa-67ab-4bb1-9c85-ace033f5cc72 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081841 Jun 22 20:10:37.544647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 860/1983] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:37 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:38.477243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:38.477835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:38.485084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:38.485537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:38.486296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:38.486728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:38.558770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:38.571937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-69b1bef6-f388-4356-87b3-55a49b748f8e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098510 Jun 22 20:10:38.572887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 861/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:38 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:38.578859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:38.579463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:38.585500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:38.585956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:38.586703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:38.587133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:38.647429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:38.655647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-131b7511-ec87-4a1f-9ae0-cbba354780e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081614 Jun 22 20:10:38.656282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 862/1985] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:38 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:39.595425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:39.596464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:39.607364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:39.608134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:39.609153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:39.609583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:39.675064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:39.687280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5dfdf1f8-e82c-4acd-9d62-fd929194228f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098350 Jun 22 20:10:39.687865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 863/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:39 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:39.692217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:39.692814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:39.698832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:39.699279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:39.700060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:39.700499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:39.761184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:39.771286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f3d4e550-db1c-441b-86e9-72afdf2cdfb7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082419 Jun 22 20:10:39.771865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 864/1987] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:39 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:40.708166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:40.709609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:40.719584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:40.720034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:40.720829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:40.721249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:40.790569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:40.801480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b060c964-df6d-45b9-ba19-f7daed51054d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099765 Jun 22 20:10:40.802053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 865/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:40.807543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:40.808134 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:40.815190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:40.815639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:40.816441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:40.816872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:40.878064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:40.886474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-871c8bf9-c655-495e-9791-64816e06464d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083527 Jun 22 20:10:40.887088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 866/1989] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:40 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:41.823257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:41.824424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:41.827799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=87 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:41.833457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:41.833912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:41.835028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:41.835454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:41.899911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:41.908893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8f2f0242-7057-4f0b-a896-7a2b00665173 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092440 Jun 22 20:10:41.909473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 867/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:41.913751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:41.914343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:41.919960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:41.920443 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:41.921197 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:41.921625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:41.986376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:41.994506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f920d5f8-edd6-4e80-a098-8f02d2387c36 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084101 Jun 22 20:10:41.995073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 868/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:41 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:42.929051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:42.929919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:42.939505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:42.939947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:42.940731 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:42.941157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:43.007686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:43.016321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e576e5f3-d44f-41ea-b383-d9828965fb30 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093882 Jun 22 20:10:43.016899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 869/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:43.021201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:43.021795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:43.027719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:43.028205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:43.028952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:43.029377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:43.095352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:43.103417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8be7bbfd-927d-4bed-a7f3-1b5ec13379fc tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085598 Jun 22 20:10:43.103985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 870/1993] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:43 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:44.037430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:44.038544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:44.048395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:44.048839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:44.049587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:44.050012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:44.118078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:44.126568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ac0073b3-8e37-457f-99e6-73eeff1bc580 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095790 Jun 22 20:10:44.127111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 871/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:44 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:44.131355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:44.131940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:44.137369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:44.137805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:44.138546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:44.138966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:44.217837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:44.226632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f34ced30-7a37-4233-b0ad-77dac09f6804 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.098562 Jun 22 20:10:44.227236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 872/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:44 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:45.147425 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:45.148623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:45.158358 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:45.158801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:45.159569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:45.159991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:45.224930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:45.233254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-54313c3d-d729-4b68-8a27-3cd9242e87d6 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092330 Jun 22 20:10:45.233847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 873/1996] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:45.243415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:45.244041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:45.250174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:45.250633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:45.251390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:45.251822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:45.319208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:45.327571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e7c483c0-ccdf-44e4-8dae-79fdc1ddad31 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087684 Jun 22 20:10:45.328292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 874/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:45 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:46.254113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:46.255195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:46.265585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:46.266031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:46.266748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:46.267199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:46.340027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:46.343540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:46.348885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-68ce92d2-4820-4a82-8ed5-1661500ae158 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.101253 Jun 22 20:10:46.349459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 875/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:46.353913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:46.354496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:46.360162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:46.360601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:46.361349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:46.361769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:46.420835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:46.429265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f07e6cb0-ff49-4218-a910-e3d91812fc48 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.078861 Jun 22 20:10:46.429811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 876/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:46 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:47.370069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:47.371210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:47.380263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:47.380714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:47.381479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:47.381910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:47.456552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:47.465280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7f977007-4447-49e7-8f3a-82edefa1785b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.101873 Jun 22 20:10:47.472230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 877/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:47.472230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:47.472230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:47.477284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:47.477722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:47.478507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:47.478936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:47.543304 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:47.553636 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d2ea1bb2-9721-4b41-8583-c71861e97935 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086862 Jun 22 20:10:47.554247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 878/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:47 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:48.486494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:48.487112 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:48.494059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:48.494503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:48.495267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:48.495691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:48.561594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:48.570167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ce2eab93-76bd-4e1e-b3b3-3711e2fb5d1a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090262 Jun 22 20:10:48.570699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 879/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:48 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:48.575180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:48.575808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:48.581614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:48.582053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:48.582804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:48.583226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:48.644117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:48.652180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d4fc8b74-f07e-46f0-b4c9-4eed50e97686 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.080483 Jun 22 20:10:48.652757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 880/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:48 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:48.656999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:10:48.657521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:10:49.591193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:49.592162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:49.600451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:49.600905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:49.601659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:49.602095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:49.664962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:49.673234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-45de6394-139e-476e-9aab-65861738b6b4 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088377 Jun 22 20:10:49.673945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 881/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:49.678338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:49.678933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:49.684738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:49.685176 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:49.685930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:49.686375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:49.748979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:49.757130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f1b7dc41-a039-4df6-a69c-e02254143388 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082238 Jun 22 20:10:49.757741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 882/2005] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:49 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:50.394766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:10:50.395054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:10:50.696897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:50.706577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:50.710630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:50.711156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:50.712092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:50.712634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:50.780074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:50.788678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b948c5a1-6875-40c4-8016-60dfdb56da91 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100796 Jun 22 20:10:50.789234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 883/2006] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:50 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:50.793928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:50.794508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:50.800446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:50.800884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:50.801629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:50.802053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:50.873697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:50.882204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3bb14b33-e040-48c6-ab9d-11f9186dffa0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092049 Jun 22 20:10:50.882765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 884/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:50 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:51.810473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:51.811534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:51.820072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:51.820548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:51.821318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:51.821745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:51.891630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:51.900064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1304c555-d010-4800-b259-5e098564b3f3 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096365 Jun 22 20:10:51.900632 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 885/2008] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:51.905038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:51.905623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:51.911377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:51.911814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:51.912580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:51.913002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:51.976368 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:51.988808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a1065bd9-702b-400a-bf1f-da5742fa2de6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087219 Jun 22 20:10:51.989393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 886/2009] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:51 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:52.921146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:52.922274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:52.931594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:52.932049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:52.932870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:52.933301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:52.997925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:53.006253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-37b99858-a26d-46a2-8a2a-624c52acbf32 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.091744 Jun 22 20:10:53.006805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 887/2010] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:52 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:53.011249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:53.011839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:53.017758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:53.018210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:53.018958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:53.019381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:53.078709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:53.087468 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9dcbbfae-d944-45c3-8406-8e5300c13111 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.079685 Jun 22 20:10:53.088032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 888/2011] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:53 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:54.032356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:54.033462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:54.041790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:54.042235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:54.042985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:54.043406 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:54.111432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:54.121187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2d7d35b6-00b2-4f28-a071-e259963c9854 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100169 Jun 22 20:10:54.121743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 889/2012] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:54.127673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:54.128303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:54.134653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:54.135129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:54.135939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:54.136403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:54.352139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:54.360081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-676d4b3b-9c64-4e5d-b5fd-88037d5dbc0a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.237309 Jun 22 20:10:54.360688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 890/2013] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:54 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:55.142187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:55.143524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:55.151662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:55.152128 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:55.152873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:55.153295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:55.217806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:55.226145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1991780b-46b2-46f7-a251-33f7a0866675 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090362 Jun 22 20:10:55.226698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 891/2014] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:55.381049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:55.382086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:55.389450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:55.389967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:55.390855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:55.391390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:55.412186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:10:55.462273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:55.472476 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f90f54b1-bc01-424b-9ac1-fea4e214d6ae tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097816 Jun 22 20:10:55.473282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 892/2015] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:55 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:56.247566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:56.248762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:56.258650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:56.259099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:56.259844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:56.260311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:56.320811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:56.329017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9ad2d0a1-18c2-463b-ae90-c5c83f6cd272 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.087866 Jun 22 20:10:56.329567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 893/2016] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:56 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:56.493160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:56.493800 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:56.500422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:56.500867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:56.501629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:56.502054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:56.562916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:56.571527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42bb353b-2105-418d-a826-cd7996d6eeaf tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083876 Jun 22 20:10:56.572122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 894/2017] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:56 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:57.349733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:57.350831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:57.361651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:57.362378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:57.363608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:57.364365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:57.428486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:57.437089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-04a7217c-50b9-4a0d-b046-53de80287092 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093942 Jun 22 20:10:57.437649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 895/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:57.600801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:57.601478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:57.608307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:57.608782 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:57.609591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:57.610043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:57.680866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:57.688949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-27f2e9f3-c066-45a8-9a83-d567fbb7e050 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097345 Jun 22 20:10:57.689525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 896/2019] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:57 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:58.458486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:58.459829 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:58.470944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:58.471720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:58.473045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:58.473852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:58.537790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:58.550544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ac4945f3-8d88-4d65-a93d-f2a27a7643ad tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098189 Jun 22 20:10:58.551339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 897/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:58 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:58.711281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:58.711958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:58.718826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:58.719330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:58.720215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:58.720739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:58.782769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:58.791417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e0c76d1-ebb4-49e2-8704-a5f45b87caee tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086106 Jun 22 20:10:58.791938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 898/2021] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:58 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:59.572492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:59.573580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:59.585059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:59.585680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:59.586450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:59.586886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:59.664879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:59.672989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-10feb0d3-365d-4dae-85ca-065e94dcd486 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.107177 Jun 22 20:10:59.673556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 899/2022] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:10:59.812145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:10:59.813085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:10:59.821995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:59.822444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:59.823214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:10:59.823637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:10:59.886557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:10:59.895319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-87418b8c-a107-4d20-bdb5-29fcbb4f82c7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089478 Jun 22 20:10:59.895859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 900/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:10:59 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:00.694341 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:00.695501 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:00.706559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:00.707308 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:00.708631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:00.709713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:00.782808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:00.795788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-317a88f2-7cde-4240-8494-ab2b9abd812b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.107749 Jun 22 20:11:00.796671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 901/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:00.915262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:00.916301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:00.926591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:00.927336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:00.928635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:00.929457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:00.990238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:00.998841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0cb25609-a82e-4a32-88b0-3e51e9c196a9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089925 Jun 22 20:11:00.999431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 902/2025] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:00 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:11:01.819934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:01.821053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:01.831856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:01.832649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:01.834295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:01.835011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:01.900163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:01.913260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-07e67191-deb5-483f-ae2d-2e5d286d580d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099640 Jun 22 20:11:01.914042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 903/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:02.019708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:02.020743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:02.030965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:02.031704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:02.033402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:02.034119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:02.098675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:02.107001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b222b9d8-33f0-47bc-b892-3f64039a7293 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093402 Jun 22 20:11:02.107568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 904/2027] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:02 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:02.934388 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:02.935439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:02.946295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:02.946885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:02.947661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:02.948135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:03.009853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:03.018224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-195e4954-7813-4e0a-be57-175f4703ae86 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090408 Jun 22 20:11:03.018799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 905/2028] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:02 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:03.128305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:03.129305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:03.139588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:03.140419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:03.141679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:03.142398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:03.205519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:03.214164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-350af5a3-cd1d-44bf-a2c7-f7199917445f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092400 Jun 22 20:11:03.214737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 906/2029] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:03 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:04.039059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:04.040206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:04.047513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:04.047964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:04.048783 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:04.049214 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:04.121350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:04.129847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-21a7d066-2beb-44e6-a636-18e150e35ead tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097381 Jun 22 20:11:04.130426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 907/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:04.234478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:04.235488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:04.245550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:04.245979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:04.246762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:04.247191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:04.308029 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:04.316477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e69e4493-cb1f-4d3d-b4f9-0d35507f9508 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.088227 Jun 22 20:11:04.317041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 908/2031] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:04 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:05.151319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:05.152236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:05.160489 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:05.161040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:05.161979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:05.162500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:05.167430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:11:05.228315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:05.236549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c5addcd0-ccd6-4fa3-b346-bae721d81ef0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092193 Jun 22 20:11:05.237113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 909/2032] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:05.337701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:05.338711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:05.349611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:05.350465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:05.351748 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:05.352522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:05.415105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:05.423882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-438ed220-fffb-434f-8b82-cb10e8918997 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092872 Jun 22 20:11:05.424479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 910/2033] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:05 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:06.261393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:06.262139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:06.269313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:06.269760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:06.270528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:06.270964 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:06.341757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:06.350163 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-04ddff26-95ba-4b6f-9e4c-9f30af939715 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094877 Jun 22 20:11:06.350727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 911/2034] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:06.444056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:06.445242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:06.455371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:06.456135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:06.457403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:06.458093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:06.523361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:06.531561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-243016f7-0836-4023-b519-d943fc16dcdb tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093513 Jun 22 20:11:06.532127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 912/2035] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:06 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:07.370741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:07.371556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:07.379900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:07.380499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:07.381446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:07.381991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:07.446875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:07.455252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ef6e785a-5617-47dd-a2ad-13151bd4b000 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090914 Jun 22 20:11:07.455831 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 913/2036] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:07.559282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:07.560318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:07.570534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:07.571268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:07.572736 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:07.573166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:07.635493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:07.643814 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d5df3235-04f8-45ac-aa2c-1b759197b570 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091165 Jun 22 20:11:07.644420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 914/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:07 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:11:08.476600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:08.478497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:08.485363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:08.485838 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:08.486626 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:08.487074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:08.551683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:08.560295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-58e5a76c-f80e-4545-bbe7-eccff0431218 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090153 Jun 22 20:11:08.560867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 915/2038] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:08 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:08.661278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:08.661877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:08.668453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:08.668879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:08.669654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:08.670072 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:08.731243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:08.739575 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4ae53000-e802-4bc0-9270-13b422eff522 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082226 Jun 22 20:11:08.740242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 916/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:08 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:11:09.581573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:09.582713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:09.586616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:11:09.592903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:09.593344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:09.594125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:09.594549 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:09.665522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:09.674051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-83e702bf-3b84-4923-a992-a0ad244d0747 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099117 Jun 22 20:11:09.674637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 917/2040] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:09.761298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:09.761972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:09.768682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:09.769150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:09.769944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:09.770396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:09.844777 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:09.853257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6547a477-8c8f-41bd-9f85-21a7942952b9 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097857 Jun 22 20:11:09.853994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 918/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:09 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:10.691686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:10.692426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:10.699344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:10.699789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:10.700581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:10.701020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:10.774050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:10.782254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5a73b5a0-3eb2-48d9-aa30-ac9fb2bcbbbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094539 Jun 22 20:11:10.782792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 919/2042] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:10.873543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:10.874283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:10.881974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:10.882522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:10.883497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:10.884020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:10.949790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:10.958272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6a23bef4-8acc-4ec5-835d-5e52dec5d306 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.090015 Jun 22 20:11:10.959188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 920/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:10 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:11.806272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:11.808082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:11.816140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:11.816602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:11.817367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:11.817984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:11.882122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:11.894641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a481cd4d-a8d8-4a9a-9c3d-5feb3b12cfab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097141 Jun 22 20:11:11.895436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 921/2044] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:11.978179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:11.979174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:11.985657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:11.986106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:11.986867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:11.987299 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:12.056260 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:12.064503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-18732192-6c74-4f2e-96b8-ea8cdfed6a79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092356 Jun 22 20:11:12.064989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 922/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:11 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:12.918415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:12.919259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:12.928474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:12.929081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:12.930091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:12.930663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:13.002544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:13.011399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8c0bf139-7c9f-4048-a2b0-4383e5bedc5a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099661 Jun 22 20:11:13.011963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 923/2046] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:13.085203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:13.086190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:13.093700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:13.094149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:13.094903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:13.095335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:13.166372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:13.183624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ffe99b1f-c267-4d90-a1a5-db33739a994a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.104802 Jun 22 20:11:13.184119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 924/2047] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:13 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:14.032457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:14.033586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:14.044545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:14.045343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:14.046631 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:14.047349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:14.113507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:14.116961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:11:14.121920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ab2a1dc4-6f13-4792-bdb0-a970dcfa1bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096115 Jun 22 20:11:14.122522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 925/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:14.204781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:14.205770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:14.215776 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:14.216255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:14.217011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:14.217442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:14.284855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:14.293488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4fd89923-d662-49dc-ba12-510459dbdfc5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094917 Jun 22 20:11:14.294035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 926/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:14 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:15.143526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:15.144687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:15.155806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:15.156608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:15.157866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:15.158592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:15.225061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:15.233730 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-64fa0899-5c90-477c-bbcf-93bbab9b43f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096880 Jun 22 20:11:15.234312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 927/2050] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:15.313677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:15.314715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:15.324457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:15.324928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:15.325700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:15.326132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:15.388049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:15.396590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-16eba4d8-6297-4247-88a9-7c64f0d4ac9c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089247 Jun 22 20:11:15.397099 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 928/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:15 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:16.251655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:16.252414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:16.259486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:16.259981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:16.260997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:16.261471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:16.328948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:16.337820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fb4611a2-144a-4ca9-9728-aa2d3c8f828d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090885 Jun 22 20:11:16.338438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 929/2052] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:16.417257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:16.418065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:16.425742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:16.426184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:16.427102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:16.427712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:16.494013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:16.503051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c3df074d-421a-4bc9-a9ce-5d8710b6146e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091787 Jun 22 20:11:16.503653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 930/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:16 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:17.358402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:17.359345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:17.368280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:17.368880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:17.369868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:17.370431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:17.436751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:17.444722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-43c77e1f-9dea-4eac-b1fc-b16d068adb80 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092333 Jun 22 20:11:17.445258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 931/2054] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:17.526198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:17.527243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:17.537578 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:17.538370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:17.539576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:17.540338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:17.604836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:17.617551 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ed8a7b53-75f9-4147-9a62-4206a1484788 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097410 Jun 22 20:11:17.618243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 932/2055] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:17 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:18.466288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:18.467027 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:18.474756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:18.475259 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:18.476131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:18.476621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:18.541032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:18.549246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d7d8c721-540f-410a-931f-a7bdd6bda20a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088638 Jun 22 20:11:18.549757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 933/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:18 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:18.638493 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:18.639524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:18.649681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:18.650568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:18.651805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:18.652268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:18.715345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:18.726931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-36b91802-9ab4-4a7b-8f8f-951fa5a94d73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094422 Jun 22 20:11:18.727689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 934/2057] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:18 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:19.570665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:19.571621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:19.579635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:19.580143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:19.580941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:19.581399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:19.651212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:19.663995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8b00c8d9-cd83-42f4-ba76-1c45eacafca0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099679 Jun 22 20:11:19.664747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 935/2058] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:19.748478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:19.749300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:19.759193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:19.759923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:19.761227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:19.762222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:19.832785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:19.841151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-13d9447e-3c2e-4f0f-8f23-1fd4a8d4c982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.098931 Jun 22 20:11:19.841733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 936/2059] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:20.685217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:20.685916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:20.693146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:20.693593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:20.694348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:20.694769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:20.763124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:20.771779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2540063d-b2aa-44d4-bef6-37e23c3b2584 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092347 Jun 22 20:11:20.772427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 937/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:20.861238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:20.862236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:11:20.872015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:20.872491 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:20.873257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:11:20.873688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:11:20.935346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:11:20.943754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-768fac93-bf72-4079-89b5-7d6d65d01841 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.088908 Jun 22 20:11:20.944374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 938/2061] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:11:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:11:21.566640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-446970ff-53c6-425a-beb4-c2ac68505ae3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4933a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:11:30.867728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=43 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:11:30.939927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=78 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:06.835015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:12:06.836404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:12:14.792346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:12:14.793664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:12:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:12:15.995943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:12:15.996921 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:12:19.007152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8352bf33-0cee-4872-b998-fd45e8532d53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 117.508710 Jun 22 20:12:19.007761 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1124/2062] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:10:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 117510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:12:19.084933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:19.085548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:19.093122 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:19.093611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:19.094349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:19.094785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:19.162669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:19.168810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-86ebbf23-2f1b-403c-97b5-eeed955f1470 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.160020 Jun 22 20:12:19.169605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1125/2063] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:19.174374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:19.174983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:19.180913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:19.181366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:19.182162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:19.182582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:19.202975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-446970ff-53c6-425a-beb4-c2ac68505ae3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 352 microversion: 2.1 time: 57.642847 Jun 22 20:12:19.210705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 939/2064] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:11:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 352 bytes in 57645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:12:19.243868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f7bf839-b8e2-4d4c-b98a-8f81ed8b85f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e481940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:19.259928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:19.268086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bffa3718-eaae-456f-95a6-d15317d65aa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097227 Jun 22 20:12:19.268681 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1126/2065] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:20.186580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:20.187287 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:20.194123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:20.194859 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:20.195821 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:20.196384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:20.261576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:20.270140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a764c431-b1a7-4c8b-860a-08e27f8af3d0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088038 Jun 22 20:12:20.270708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1127/2066] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:20.287412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:20.288028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:20.294687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:20.295430 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:20.296444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:20.297081 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:20.372522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:20.380487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5289afd9-ad31-4952-bea8-14ee5992caec tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.097256 Jun 22 20:12:20.381058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1128/2067] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:20.590162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-5f7bf839-b8e2-4d4c-b98a-8f81ed8b85f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f7bf839-b8e2-4d4c-b98a-8f81ed8b85f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Request method failure captured: Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 HTTP/1.1 Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3XJyq8jYscwv2tAJSEXDGSSeN50--NGd-ShBjOBt2g6rhZkGl7ye4TOoFM4vvRnQPMhWM7YTHPts_hoGSNmq6XTei0-wPmOfR8ehmyckmLO9CPBoMynFdMfBpFNqchb_t7HxC6t8rbujqDUNCxaPJraBbCnazpPaWhd2EX4IVuK93Y Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 1c69b53229664305908613faf2aff66e Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesGetTestJSON-1591880227 Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:12:20.592224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c69b53229664305908613faf2aff66e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c69b53229664305908613faf2aff66e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c69b53229664305908613faf2aff66e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c69b53229664305908613faf2aff66e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesGetTestJSON-1591880227 Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 1c69b53229664305908613faf2aff66e Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesGetTestJSON-1591880227 Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesGetTestJSON-1591880227-project Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 316a2a17d719498c8139a38067bdcf68 Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesGetTestJSON-1591880227-project Jun 22 20:12:20.594093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '956ea3e6-8518-45c7-b689-b413a4add336'} Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 20:12:20.598371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:12:20.600457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.602081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 138, in delete Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:12:20.603444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f7bf839-b8e2-4d4c-b98a-8f81ed8b85f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-cb5031ff-73ff-4e02-98f8-73ca0c151845) {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5f7bf839-b8e2-4d4c-b98a-8f81ed8b85f8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 400 len: 397 microversion: 2.1 time: 1.353679 Jun 22 20:12:20.604940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 940/2068] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 20:12:19 2022] DELETE /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 397 bytes in 1355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 20:12:20.605599 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-37a300a5-7a42-4bf3-bd9b-1ae0353594a6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:21.292545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:21.293762 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:21.301411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:21.301784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:21.302543 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:21.302972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:21.365970 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:21.374119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0198ddf8-9bff-480d-b2d4-4d0b056984a1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088284 Jun 22 20:12:21.374699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 941/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:21 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:21.397655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:21.398376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:21.404881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:21.405333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:21.406102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:21.406533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:21.474909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:21.483270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-652928f1-a861-4894-81cd-0af40d796562 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089760 Jun 22 20:12:21.483860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 942/2070] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:21 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:22.391235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:22.391904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:22.398539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:22.398996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:22.399746 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:22.400199 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:22.463037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:22.471990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c7f463d0-a108-412f-9667-27b0ecc41716 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.084653 Jun 22 20:12:22.472601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 943/2071] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:22 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:22.500567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:22.501172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:22.507755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:22.508230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:22.508991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:22.509422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:22.580504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:22.588913 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8e2b8320-9250-4ad9-8c71-fe39fcb77a50 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092727 Jun 22 20:12:22.589813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 944/2072] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:22 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:23.489414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:23.490142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:23.496933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:23.497459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:23.498452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:23.499005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:23.560904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:23.569227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ebaaea5c-93dd-4782-8b52-73aac73a6758 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.083909 Jun 22 20:12:23.569787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 945/2073] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:23 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:23.606194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:23.606870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:23.614844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:23.615375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:23.618101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:23.618101 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:23.690474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:23.698729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-df3b2551-452b-418e-b85c-49aff319e4ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.096423 Jun 22 20:12:23.699301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 946/2074] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:23 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:24.591069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:24.592050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:24.603001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:24.603812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:24.605104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:24.605813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:24.670320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:24.678916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6dd2b33a-e7df-40f1-aa28-ecdff18719ea tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094627 Jun 22 20:12:24.679488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 947/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:24 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:24.715830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:24.716463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:24.722770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:24.723212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:24.723962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:24.724427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:24.795396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:24.803648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b24ce606-bbcf-4edd-a197-aa7b2c15108f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091312 Jun 22 20:12:24.804246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 948/2076] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:24 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:25.704133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:25.705194 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:25.715694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:25.716560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:25.717471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:25.717901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:25.785873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:25.793839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f922c398-0503-46b7-8473-c7084817bdbc tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099863 Jun 22 20:12:25.794421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 949/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:25 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:25.820587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:25.821196 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:25.827347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:25.827816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:25.828611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:25.829015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:25.892225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:25.900666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d05c47d6-f038-4383-b0b7-08851a6602a4 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083668 Jun 22 20:12:25.901236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 950/2078] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:25 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:26.815129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:26.816448 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:26.827428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:26.827980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:26.829139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:26.829758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:26.899114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:26.907512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ee08b36e-af01-4db0-aa1e-673e7ef6a10f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099101 Jun 22 20:12:26.908118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 951/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:26 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:26.917316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:26.917919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:26.924064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:26.924532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:26.925281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:26.925707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:26.999672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:27.008254 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aca9a5e0-1a47-42f3-978d-ce4c44557a1d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.094513 Jun 22 20:12:27.008827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 952/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:26 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:27.928668 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:27.929826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:27.938727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:27.939178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:27.939947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:27.940416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:28.009801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:28.018249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c270a6a2-a007-4269-8c1e-b7e90feb2d67 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096226 Jun 22 20:12:28.018819 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 953/2081] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:27 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:28.024643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:28.025246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:28.031305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:28.031753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:28.032544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:28.032981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:28.097570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:28.105707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b1534603-168a-45a5-b956-9f537c1a8b0c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084540 Jun 22 20:12:28.106584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 954/2082] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:28 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:29.039074 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:29.040248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:29.048832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:29.049281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:29.050052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:29.050483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:29.112610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:29.121243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2f5a79c5-d38d-42fb-9974-3386b6b78d73 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088806 Jun 22 20:12:29.121923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 955/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:29 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:29.126518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:29.127115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:29.132955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:29.133397 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:29.134158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:29.134588 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:29.205930 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:29.214399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85a16479-a7b9-4638-a65f-3271f4ae1e27 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091543 Jun 22 20:12:29.214958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 956/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:29 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:30.141937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:30.143094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:30.153906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:30.154656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:30.155914 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:30.156654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:30.174804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:30.219951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:30.231856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-de550136-801a-4378-b651-b7ac07412726 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096312 Jun 22 20:12:30.232602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 957/2085] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:30 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:30.237333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:30.237929 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:30.243976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:30.244562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:30.245357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:30.245901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:30.291852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=8 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:30.307795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:30.315898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1a8b1f8b-2301-45d2-bd7d-f3b74296cada tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082339 Jun 22 20:12:30.316515 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 958/2086] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:30 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:30.376682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=24 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:31.254012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:31.254956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:31.266085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:31.266743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:31.267735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:31.268195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:31.339955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:31.348231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4b472518-70f5-45b3-bcb7-62e4f2dbcb2a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100825 Jun 22 20:12:31.348772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 959/2087] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:31 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:31.353080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:31.353697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:31.359333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:31.359766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:31.360546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:31.360965 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:31.430672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:31.438935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-46e88c2d-d14c-4bff-95fb-d0fc45d1dfb2 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089212 Jun 22 20:12:31.439492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 960/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:31 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:32.369120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:32.370131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:32.379007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:32.379465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:32.380275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:32.380702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:32.457464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:32.470926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-54c7aa6f-e931-4f1d-ae1e-e5c85ed1c7fd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.108271 Jun 22 20:12:32.471586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 961/2089] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:32 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:32.477863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:32.478459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:32.484974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:32.485427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:32.486324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:32.486778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:32.549656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:32.557822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2150a636-09b2-4efd-905b-2b651754d3ab tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085267 Jun 22 20:12:32.558393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 962/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:32 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:33.489607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:33.490252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:33.497230 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:33.497669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:33.498438 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:33.498867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:33.562580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:33.570883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9817eec2-cd9d-4d20-9ee8-4dbb8c28af04 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.085395 Jun 22 20:12:33.571458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 963/2091] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:33 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:33.575922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:33.576552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:33.583049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:33.583508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:33.584290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:33.585053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:33.650410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:33.659115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7de9e207-1d8a-4512-a57a-e19920e67b4b tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086698 Jun 22 20:12:33.659688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 964/2092] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:33 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:34.592880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:34.593900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:34.601843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:34.602287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:34.603035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:34.603458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:34.677411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:34.689585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-49c2a5f0-05ec-4b9b-afa7-12efa76b62be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.103255 Jun 22 20:12:34.690255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 965/2093] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:34 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:34.694688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:34.695284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:34.702255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:34.702857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:34.703938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:34.704473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:34.777721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:34.788135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5299e9a9-f96f-405c-be88-a214cda67982 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.096917 Jun 22 20:12:34.788797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 966/2094] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:34 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:35.711139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:35.712269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:35.723295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:35.724043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:35.725362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:35.726084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:35.792832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:35.801281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-29b67687-de1f-416d-b195-c8c434d34f6c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097163 Jun 22 20:12:35.801840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 967/2095] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:35 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:35.807707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:35.808341 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:35.814145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:35.814592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:35.815423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:35.815856 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:35.879174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:35.887188 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0b0ef41e-3fd6-406b-94bd-477ee3f2183f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082995 Jun 22 20:12:35.887780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 968/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:35 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:36.822537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:36.823618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:36.835004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:36.835744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:36.837035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:36.837763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:36.903995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:36.916185 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a0abdda5-e6cb-4598-8c30-dc4d39a6462f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100402 Jun 22 20:12:36.917202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 969/2097] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:36 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:36.922282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:36.922967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:36.930712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:36.931151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:36.931903 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:36.932374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:37.002886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:37.011095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-226624fb-66a6-4e76-a057-528246c6887f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092495 Jun 22 20:12:37.011664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 970/2098] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:36 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:37.938623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:37.939709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:37.950607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:37.951333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:37.952604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:37.953318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:38.023692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:38.031936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3e7df9b8-9587-46a2-b9d9-bdb33dd37b1e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100011 Jun 22 20:12:38.032561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 971/2099] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:37 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:38.037075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:38.037660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:38.043405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:38.043834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:38.044609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:38.045020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:38.109968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:38.121888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-68ac8984-8ea9-4e5a-a5b5-3ccb2652481d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.088174 Jun 22 20:12:38.122713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 972/2100] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:38 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:39.053086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:39.054166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:39.065125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:39.065869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:39.067269 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:39.067693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:39.136007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:39.144589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72678fda-cf63-49f8-99b8-46fe371ac308 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098075 Jun 22 20:12:39.145270 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 973/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:39 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:39.149550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:39.150144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:39.155785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:39.156265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:39.157018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:39.157444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:39.161321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:39.219055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:39.227385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8ab1a84b-3e18-47aa-aa22-aa9bb1b2c1a0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081255 Jun 22 20:12:39.227951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 974/2102] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:39 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:40.165642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:40.166648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:40.177713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:40.178162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:40.178925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:40.179387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:40.245979 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:40.254843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-50b796af-7829-4ded-a80e-d9d8b8060238 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095870 Jun 22 20:12:40.255483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 975/2103] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:40 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:40.259975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:40.260603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:40.266550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:40.266995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:40.267774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:40.268213 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:40.334180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:40.345233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6693b08c-41a5-4efd-869a-0088f99ac673 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.088805 Jun 22 20:12:40.345795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 976/2104] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:40 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:41.276090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:41.277266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:41.287723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:41.288202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:41.288972 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:41.289409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:41.357609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:41.368256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2ffd40ed-8c99-47ff-8dd2-fcd85fd9f513 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.098744 Jun 22 20:12:41.368845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 977/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:41 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:41.373248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:41.373845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:41.379790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:41.380281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:41.381034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:41.381463 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:41.460217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:41.469100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-345dd3d2-18ec-48ad-a4c9-56b678b11ec5 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.099255 Jun 22 20:12:41.470106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 978/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:41 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:42.385467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:42.386133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:42.392641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:42.393078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:42.393826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:42.394247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:42.468031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:42.478790 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a87954b8-fb02-446a-b110-d17920d2134e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.097258 Jun 22 20:12:42.479381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 979/2107] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:42 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:42.485362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:42.485962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:42.492001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:42.492469 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:42.493229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:42.493647 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:42.561015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:42.569677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-44407f1d-7fac-48a3-892f-ec213f214c53 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087985 Jun 22 20:12:42.570369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 980/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:42 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:43.495453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:43.496068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:43.503091 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:43.503537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:43.504340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:43.504772 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:43.566605 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:43.574840 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-26d7a674-db30-4136-9b34-1e5d7e766c25 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.083395 Jun 22 20:12:43.575410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 981/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:43 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:43.587205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:43.587807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:43.594228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:43.594675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:43.595427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:43.595851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:43.659935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:43.668371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-912326a9-7017-4e0c-9f55-6f92cc08b7dd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085443 Jun 22 20:12:43.668937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 982/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:43 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:44.596671 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:44.597685 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:44.609066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:44.609801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:44.611065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:44.611767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:44.677711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:44.690089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4d75d2ae-045e-4b6a-bb99-f35e022c1916 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100000 Jun 22 20:12:44.690873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 983/2111] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:44 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:12:44.695610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:44.696248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:44.702077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:44.702550 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:44.703309 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:44.703739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:44.767937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:44.776273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e137df86-0b94-4049-bb7d-3837efc4d305 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084423 Jun 22 20:12:44.776842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 984/2112] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:44 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:45.711513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:45.712769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:45.723692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:45.724521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:45.725678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:45.726115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:45.791125 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:45.799740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-62b2a343-b228-482e-bc9c-a294c6d3a16f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095188 Jun 22 20:12:45.800336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 985/2113] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:45 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:45.804809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:45.805369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:45.811384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:45.811828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:45.812612 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:45.813034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:45.876830 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:45.885159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5414dbb3-db00-4a47-b60c-f47de127a540 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083903 Jun 22 20:12:45.885724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 986/2114] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:45 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:46.819430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:46.820960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:46.827932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:46.828526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:46.829474 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:46.830017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:46.892473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:46.900648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-53b895f7-b5ab-4514-83c2-2ad6c9663bcb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.086805 Jun 22 20:12:46.901203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 987/2115] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:46 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:46.905514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:46.906103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:46.911850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:46.912321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:46.913140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:46.913566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:46.977025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:46.985062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d2b17e15-32d2-4d19-8b9e-b9d88a19c91f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082937 Jun 22 20:12:46.985634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 988/2116] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:46 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:47.922131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:47.923211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:47.934141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:47.934897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:47.936565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:47.937282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:48.002030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:48.010514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b0613d36-8947-4782-9c87-cbc1e2b113df tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095139 Jun 22 20:12:48.011094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 989/2117] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:47 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:48.015724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:48.016354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:48.019033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:48.022792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:48.023239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:48.023999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:48.024464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:48.096324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:48.099717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:48.105371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aa42a398-d216-479e-b69d-622b4cd7f599 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093314 Jun 22 20:12:48.105945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 990/2118] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:48 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:49.032462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:49.033524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:49.044635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:49.045384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:49.046650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:49.047387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:49.111380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:49.119531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fae9fefd-fba6-45bc-b18d-0c8ee4ad594b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094202 Jun 22 20:12:49.120087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 991/2119] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:49 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:49.124462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:49.125062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:49.130981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:49.131426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:49.132392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:49.132821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:49.210179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:49.222512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-725b8331-d826-451f-aefe-f0d7e8bcdcf3 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.101272 Jun 22 20:12:49.223279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 992/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:49 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:50.140393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:50.141545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:50.152556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:50.153300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:50.154564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:50.155268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:50.222059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:50.230380 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a6ef2592-f5d4-447b-9640-94885e874ce5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096582 Jun 22 20:12:50.230974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 993/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:50 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:50.240148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:50.241084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:50.247225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:50.247664 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:50.248716 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:50.248895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:50.318989 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:50.327600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a824ec8c-4ff0-4555-ab95-b2fbb659ee10 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091084 Jun 22 20:12:50.328223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 994/2122] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:50 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:51.251278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:51.252426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:51.263385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:51.264159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:51.265435 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:51.266153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:51.331737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:51.340721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0bcbafa9-cf3a-44da-b403-dc2c7c088a2f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096017 Jun 22 20:12:51.341293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 995/2123] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:51 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:51.345902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:51.346503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:51.354311 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:51.354919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:51.355996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:51.356637 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:51.422686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:51.431285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-38c825c2-4100-46e5-a4b1-8ab5f3042658 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089066 Jun 22 20:12:51.431874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 996/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:51 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:52.361962 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:52.362955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:52.374679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:52.375419 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:52.376714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:52.377431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:52.440434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:52.448757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0df9860f-58cc-4df4-8b64-342c62a92a51 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.093414 Jun 22 20:12:52.449329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 997/2125] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:52 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:52.453652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:52.454236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:52.460415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:52.460863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:52.461611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:52.462037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:52.528568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:52.537022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c0721e88-d0ad-480a-94a6-a07f7135c1f6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086776 Jun 22 20:12:52.537560 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 998/2126] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:52 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:53.470536 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:53.471686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:53.483570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:53.484363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:53.485614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:53.486331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:53.560393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:53.571483 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-258a68a4-7024-452b-9cb8-abb027667591 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.107335 Jun 22 20:12:53.572257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 999/2127] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:53 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:53.576653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:53.577262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:53.584928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:53.585559 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:53.586502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:53.586931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:53.658622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:53.666919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-67a1b7e9-381e-4746-b14b-431f88d9a5ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093742 Jun 22 20:12:53.667488 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1000/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:53 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:54.594227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:54.595330 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:54.604886 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:54.605267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:54.606013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:54.606434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:54.679132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:54.691938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4fec7004-50f7-4fa2-a64e-c8eadd0daf81 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.104373 Jun 22 20:12:54.692719 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1001/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:54 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:54.697305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:54.697871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:54.703924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:54.704412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:54.705190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:54.705619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:54.768431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:54.777173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-21b53608-1585-45d6-aa36-9a30c4f0bc89 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083501 Jun 22 20:12:54.777744 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1002/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:54 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:55.714187 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:55.715257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:55.726252 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:55.726896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:55.728317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:55.729046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:55.801562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:55.810063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3a060edd-65ac-48aa-9a25-753f2120468d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.103063 Jun 22 20:12:55.810593 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1003/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:55 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:55.814975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:55.815567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:55.821100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:55.821535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:55.822312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:55.822737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:55.886880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:55.895340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a5f8390b-2d73-49ac-8131-7cf7929a3473 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083787 Jun 22 20:12:55.895876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1004/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:55 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:56.827177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:56.827779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:56.834924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:56.835369 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:56.836143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:56.836592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:56.899078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:56.907333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2f433309-9b93-420e-9296-dff91039d7f5 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.084155 Jun 22 20:12:56.907908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1005/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:56 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:56.916444 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:56.917043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:56.923224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:56.923659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:56.924454 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:56.924868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:56.990115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:56.998225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-506df1f3-7d38-419a-873d-7480cb2f28ad tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085561 Jun 22 20:12:56.998791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1006/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:56 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:57.928506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:57.929699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:57.938150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:57.938603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:57.939370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:57.939807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:57.959378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:12:58.006109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:58.016146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2904f500-6f22-4864-8abe-1dee729a9098 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094326 Jun 22 20:12:58.016720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1007/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:57 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:58.021066 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:58.021656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:58.027562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:58.028006 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:58.028779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:58.029204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:58.097546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:58.105625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-47cf74b6-e033-49ed-92cd-0438e4afb70c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.087983 Jun 22 20:12:58.106226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1008/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:58 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:59.036793 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:59.037916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:59.046896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:59.047352 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:59.048129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:59.048589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:59.120942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:59.129629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-199c670b-0c2f-40fe-9c7b-32315bcf42b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.099412 Jun 22 20:12:59.130205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1009/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:59 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:12:59.134765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:12:59.135363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:12:59.141722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:59.142170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:59.142955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:12:59.143386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:12:59.204578 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:12:59.213496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a081f514-5a00-4ed4-9530-260e1f859caa tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.082314 Jun 22 20:12:59.214079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1010/2138] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:12:59 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:00.151853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:00.153117 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:00.160629 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:00.161070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:00.161833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:00.162265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:00.232119 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:00.240609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-955d4d4c-e8ab-46c5-9537-6fb019ab2f49 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095359 Jun 22 20:13:00.241192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1011/2139] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:00.245532 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:00.246105 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:00.252404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:00.253016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:00.253866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:00.254517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:00.319618 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:00.328045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-79a1894e-b4e4-4765-9b1a-e900dd54a7c1 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085912 Jun 22 20:13:00.328619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1012/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:00 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:01.261755 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:01.262868 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:01.270471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:01.270937 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:01.271735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:01.272219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:01.343095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:01.351747 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d235fde7-f63a-4245-b32b-b1099c4dc90b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096558 Jun 22 20:13:01.352373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1013/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:01 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:01.357150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:01.357753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:01.363603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:01.364056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:01.364839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:01.365273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:01.429614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:01.437881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-794a4281-4038-4b93-91a4-95bad87ac402 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084524 Jun 22 20:13:01.438424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1014/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:01 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:02.372821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:02.373703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:02.380686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:02.381168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:02.381891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:02.382317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:02.451088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:02.460355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8edbea7e-e568-4b68-ac75-0c9068ed31b7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094063 Jun 22 20:13:02.460920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1015/2143] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:02 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:02.466192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:02.466794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:02.473179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:02.473623 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:02.474403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:02.474825 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:02.538561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:02.546681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-70524dd8-2f33-4c9b-bc97-8a4e83296444 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084819 Jun 22 20:13:02.547228 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1016/2144] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:02 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:03.485797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:03.486701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:03.493851 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:03.494305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:03.495071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:03.495505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:03.559141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:03.567546 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72a17082-ed50-4f00-aaa8-5c4f4d9283f7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.088517 Jun 22 20:13:03.568133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1017/2145] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:03 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:03.572610 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:03.573206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:03.579038 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:03.579475 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:03.580265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:03.580699 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:03.643871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:03.652157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e8f445fb-25fa-4c3a-8a22-a9ebd147cf51 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083078 Jun 22 20:13:03.652999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1018/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:03 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:04.589277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:04.590318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:04.599613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:04.600067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:04.600877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:04.601307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:04.663739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:04.671909 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-281a30db-9787-40e8-9aa0-32584f1748dd tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.089691 Jun 22 20:13:04.672508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1019/2147] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:04 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:04.677184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:04.677774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:04.683286 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:04.683737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:04.684519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:04.684951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:04.749778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:04.758426 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-85672d8a-a12f-4557-a74e-1157dbefda68 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.084927 Jun 22 20:13:04.759015 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1020/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:04 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:05.693115 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:05.694262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:05.705385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:05.705836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:05.706608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:05.707040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:05.774189 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:05.783053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-45b9b7de-3e3b-42ed-b14c-8403dd6dd157 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.096171 Jun 22 20:13:05.789347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1021/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:05 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:05.794492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:05.795106 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:05.801440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:05.801889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:05.802649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:05.803084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:05.864529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:05.876673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a03f878c-b221-4e45-b9e5-12a232c1ba73 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086066 Jun 22 20:13:05.877386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1022/2150] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:05 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:06.803255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:06.804445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:06.815007 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:06.815452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:06.816346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:06.816770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:06.879060 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:06.887183 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ac22caff-1a5c-4ba6-8be3-fa9038697d5d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.090801 Jun 22 20:13:06.887751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1023/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:06 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:06.893812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:06.894414 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:06.900697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:06.901141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:06.901901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:06.902332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:06.906354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:13:06.967248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:06.975334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6c7a9245-cd4d-4c22-a442-b227db4893df tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.085174 Jun 22 20:13:06.975892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1024/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:06 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:07.907921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:07.909042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:07.919705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:07.920508 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:07.921743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:07.922449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:07.987100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:07.995545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9430e216-aa6a-4e40-959a-f7fed5c4d58b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094213 Jun 22 20:13:07.996139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1025/2153] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:07 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:08.000460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:08.001068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:08.006980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:08.007428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:08.008234 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:08.008667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:08.077624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:08.086292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5f54397a-29bf-4494-95ed-0c3309af7852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.089202 Jun 22 20:13:08.086861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1026/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:07 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:09.017341 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:09.018432 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:09.029717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:09.030465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:09.031733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:09.032503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:09.096395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:09.104592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e70f93a5-3f76-4e24-a977-81e3de9e40ce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094026 Jun 22 20:13:09.105192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1027/2155] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:09 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:09.109713 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:09.110298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:09.116004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:09.116467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:09.117211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:09.117635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:09.181586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:09.189902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-102dd397-fcea-41f9-8e41-b5b6b93985e0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.083744 Jun 22 20:13:09.190467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1028/2156] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:09 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:10.125693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:10.126860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:10.137785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:10.138533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:10.139796 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:10.140565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:10.204541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:10.213266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8414afbc-7433-46df-b63a-200f93a3a305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094161 Jun 22 20:13:10.213832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1029/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:10 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:10.218296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:10.218899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:10.224487 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:10.224934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:10.225694 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:10.226093 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:10.286400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:10.294674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2db7b168-bbdd-49e0-b49b-bfbcf163efa7 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.079857 Jun 22 20:13:10.295211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1030/2158] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:10 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:11.230785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:11.231554 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:11.238797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:11.239243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:11.240013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:11.240481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:11.303365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:11.311882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4aa21ab8-39a8-4dde-8d11-eb2540914528 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.085151 Jun 22 20:13:11.312516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1031/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:11.316934 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:11.317529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:11.323740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:11.324225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:11.324984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:11.325429 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:11.395129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:11.403663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1cd25ead-6a09-4493-9dd4-b1f67c53f8db tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.090128 Jun 22 20:13:11.404566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1032/2160] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:11 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:12.328767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:12.329530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:12.336910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:12.337359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:12.338139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:12.338574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:12.412017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:12.420506 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-04273de5-0ad1-48e1-b135-0499fd45d3ca tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.095709 Jun 22 20:13:12.421098 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1033/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:12.425528 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:12.426130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:12.432139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:12.432611 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:12.433374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:12.433804 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:12.495079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:12.503452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b951071f-5923-404d-bf5a-21b1ef1986cd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.081423 Jun 22 20:13:12.504028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1034/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:12 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:13.441608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:13.442481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:13.451416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:13.452012 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:13.453141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:13.453700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:13.523569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:13.535883 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-085e5587-7b34-41b4-af89-a2882b89f64b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.100711 Jun 22 20:13:13.536938 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1035/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:13 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:13.542175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:13.542792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:13.549100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:13.549542 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:13.550250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:13.550693 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:13.621573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:13.630062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ce3fc6ae-17a4-4547-a5a4-eb7b963d0c79 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.091791 Jun 22 20:13:13.630615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1036/2164] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:13 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:14.554599 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:14.555298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:14.562224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:14.562682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:14.563455 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:14.563893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:14.630433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:14.642859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e88e41c6-150a-47f2-b617-1f432765695b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.092157 Jun 22 20:13:14.643649 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1037/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:14 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:14.648233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:14.648936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:14.655131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:14.655576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:14.656505 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:14.656940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:14.720803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:14.737232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-246907ce-fa93-4f55-8efc-8f1838ebbf54 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092037 Jun 22 20:13:14.738211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1038/2166] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:14 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:15.664753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:15.665921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:15.677014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:15.683059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:15.683059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:15.683059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:15.767656 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:15.776135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f3d4781e-7850-4b83-b55c-47b35ef93e9a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.118162 Jun 22 20:13:15.776732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1039/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:15 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:15.781123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:15.781724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:15.784318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:13:15.787975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:15.788451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:15.789208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:15.789638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:15.860319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:15.863990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=100 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:13:15.869779 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4801ae2a-193a-480e-ad56-d550cce68b4a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.092081 Jun 22 20:13:15.870364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1040/2168] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:15 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:16.797753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:16.798893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:16.810094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:16.810834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:16.812135 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:16.812859 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:16.891057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:16.899320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-960c9bf2-a19b-4773-bb3f-1c41627d20e2 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.108527 Jun 22 20:13:16.899889 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1041/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:16 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:17.087000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:17.087613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:17.094075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:17.094523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:17.095288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:17.095722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:17.164216 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:17.172722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b16c77f2-9b25-444d-b9f1-e5491eb4e651 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.271873 Jun 22 20:13:17.173285 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1042/2170] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:16 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:17.920477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:17.921533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:17.930710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:17.931158 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:17.931922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:17.932384 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:18.000078 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:18.008440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9db432e8-8c23-4a2b-922a-a066b2cb0901 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.094662 Jun 22 20:13:18.009017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1043/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:17 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:18.193704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:18.194427 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:18.201912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:18.202404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:18.203326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:18.203832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:18.271697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:18.280458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cc6e02c0-a89f-4a96-8116-6a682927ad01 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093234 Jun 22 20:13:18.281043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1044/2172] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:18 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:19.029355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:19.030389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:19.039910 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:19.040385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:19.041133 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:19.041556 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:19.104284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:19.112320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ef9d3bd8-3e54-47be-b7f5-3688dda56d3a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.089418 Jun 22 20:13:19.112878 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1045/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:19 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:19.301530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:19.302439 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:19.309047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:19.309490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:19.310231 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:19.310655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:19.372721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:19.381127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ec9e936e-3565-47a3-984e-5cff8408e93a tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.086177 Jun 22 20:13:19.381688 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1046/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:19 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:20.135043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:20.136174 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:20.147008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:20.147462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:20.148382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:20.148850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:20.222336 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:20.234767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7a10e5a0-4b4a-46b3-b909-ac533200b305 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.106325 Jun 22 20:13:20.235473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1047/2175] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:20 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:20.398946 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:20.399534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:13:20.406570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:20.407052 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:20.407884 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:13:20.408389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:13:20.479789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:13:20.488387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b16da72a-9e2a-4aa9-9afa-47004ebce43f tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1350 microversion: 2.1 time: 0.093797 Jun 22 20:13:20.488952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1048/2176] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:13:20 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:13:20.665391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-91e10c4b-80cb-4dc1-8e19-fe9d036cac83 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cf0b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:13:30.404190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=16 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:13:30.483876 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=48 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:13:44.428142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:13:44.429039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:14:08.666381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:14:08.666991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:14:10.407974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:14:10.408703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 (ip 10.222.0.26) !!! Jun 22 20:14:11.224075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-37a300a5-7a42-4bf3-bd9b-1ae0353594a6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 110.624709 Jun 22 20:14:11.225848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1129/2177] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:12:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 110627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:11.232091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:11.232714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:11.241242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:11.242132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:11.243759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:11.245208 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:11.311996 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-91e10c4b-80cb-4dc1-8e19-fe9d036cac83 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 50.652979 Jun 22 20:14:11.313233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1049/2178] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:13:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 50655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:11.320120 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:11.322109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:11.339561 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:11.340281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:11.340785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:11.341211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:11.341850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:11.352352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ea092727-7974-4013-aa94-c2ba9d00c921 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 200 len: 1368 microversion: 2.1 time: 0.123356 Jun 22 20:14:11.352994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1130/2179] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:11 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:11.380565 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:11.381355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:11.381828 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'fault' on Instance uuid 42be957b-1878-4d34-8da2-b0c98a90fd55 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:14:11.425092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:11.433300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0891b7a6-fd6b-481b-b7a0-ba0f0042f102 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 200 len: 1444 microversion: 2.1 time: 0.118765 Jun 22 20:14:11.433820 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1050/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:11 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:12.326029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-630b9bd1-416c-4f12-bbf7-6213346bdc49 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b5b9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.369769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.370394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:12.377232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.377715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.378459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.378894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.379204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-630b9bd1-416c-4f12-bbf7-6213346bdc49 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056775 Jun 22 20:14:12.379782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1131/2181] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:12.393208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 HTTP/1.1 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:14:12.394780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:14:12.396522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '498198b2-0179-45ba-8753-15a2d61e7018'} Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:12.397657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:14:12.399976 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.402861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:12.402861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a5ffa1eb-a7ea-4c3d-b5f1-0467179854b1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 404 len: 111 microversion: 2.1 time: 0.030651 Jun 22 20:14:12.402861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1051/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:12 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 20:14:12.404628 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.404957 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-675ddd77-79c6-4246-aa7b-7a002e12ab53 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '.version_select at 0x7fdc19b7ae50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.405143 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:12.411861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.412435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.413284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.413815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.427354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-675ddd77-79c6-4246-aa7b-7a002e12ab53 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521471856" status: 202 len: 0 microversion: 2.1 time: 0.026018 Jun 22 20:14:12.427998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.428277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1052/2183] 10.222.0.26 () {58 vars in 1217 bytes} [Wed Jun 22 20:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521471856 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da HTTP/1.1 Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:14:12.429076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.430750 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'e60784b8-22f8-4043-9656-c629245206da'} Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:12.431639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.433238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.435364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:12.435364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5951a08f-7a61-47d2-9da5-58fc75b3f8c3 tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jun 22 20:14:12.435364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1132/2184] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:14:12 2022] DELETE /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 20:14:12.438724 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.439334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] [instance: e60784b8-22f8-4043-9656-c629245206da] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:12.445687 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.446113 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.446920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.447374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.451235 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:12.453116 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: 42be957b-1878-4d34-8da2-b0c98a90fd55] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:12.458836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.459800 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.460655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:12.461163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:12.467904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] HTTP exception thrown: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Request method failure captured: Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da HTTP/1.1 Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_GeHcvMu7qJqHIIg4fyseiok4PnQ_1V3Y6LEMZubf1wB_ZkArhyR-REekgAHYRIS_LXZLmg6q-MHGgOclTGFtoG_hzEoZK2tUOnJ1KzUnHDGM3GR9h59n4i_d2dVskTd7rEH5UsE_ivvXilzlEgVEU13KQcAp9sX4MGycNf2k260M Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:14:12.470025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d644d637dd9e45f2b46f27435fe6097d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d644d637dd9e45f2b46f27435fe6097d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: d644d637dd9e45f2b46f27435fe6097d Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1157121653 Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 168c32f8fa8f4e07a8fc5418e9be4a13 Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeNegativeTest-1157121653-project Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.471925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'e60784b8-22f8-4043-9656-c629245206da'} Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:12.473544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. Jun 22 20:14:12.475251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.477290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] Returning 404 to user: Instance e60784b8-22f8-4043-9656-c629245206da could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:12.478055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ba6df149-77aa-4662-b190-ab39301fd7ce tempest-AttachVolumeNegativeTest-1157121653 tempest-AttachVolumeNegativeTest-1157121653-project] 10.222.0.26 "GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da" status: 404 len: 111 microversion: 2.1 time: 0.043133 Jun 22 20:14:12.478967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1053/2185] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:12 2022] GET /compute/v2.1/servers/e60784b8-22f8-4043-9656-c629245206da => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:14:12.482181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 HTTP/1.1 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:14:12.483863 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. Jun 22 20:14:12.485768 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '42be957b-1878-4d34-8da2-b0c98a90fd55'} Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:12.487027 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. Jun 22 20:14:12.489154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:12.490436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 404 to user: Instance 42be957b-1878-4d34-8da2-b0c98a90fd55 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:12.490436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6158633e-39f7-43ff-96f1-8289209deba6 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55" status: 404 len: 111 microversion: 2.1 time: 0.039604 Jun 22 20:14:12.490436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1133/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:12 2022] GET /compute/v2.1/servers/42be957b-1878-4d34-8da2-b0c98a90fd55 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 20:14:13.356055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4dc18493-29ab-4cf0-97fc-41558611988f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: .version_select at 0x7fdc19c4f0d0>, body: {"keypair": {"name": "tempest-keypair-1685156283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtAT35iyqITPi0gp1zsP7Q3GBMZVDxop29IjCyCoAdJR341D2N8SCbRVy4+TdEqn1zhLh6A7CSayo5rwLahANxIhGVt8kVVP5PN1XqDkMzOSMSKM16sZlqPgPLSCMHeHA=="}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:13.372503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-4dc18493-29ab-4cf0-97fc-41558611988f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:14:13.376994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-4dc18493-29ab-4cf0-97fc-41558611988f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for user 1300250a083246a3a82aed557846cb89 and project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'key_pairs'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:14:13.391369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d2df142a-3f1e-400c-a345-d77cc327bdc1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baeaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:13.400497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4dc18493-29ab-4cf0-97fc-41558611988f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048047 Jun 22 20:14:13.401322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1054/2187] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 20:14:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:13.441484 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d2df142a-3f1e-400c-a345-d77cc327bdc1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053839 Jun 22 20:14:13.442451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1134/2188] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:14.454212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e67689ad-8bd9-46bf-a141-7af5d2330ec9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2cd30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:14.507266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e67689ad-8bd9-46bf-a141-7af5d2330ec9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057204 Jun 22 20:14:14.507845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1055/2189] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:15.468368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-349977938", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eca3001-1b6f-4e98-983b-840dfedc59fb"}], "security_groups": [{"name": "tempest-securitygroup--1603547077"}], "key_name": "tempest-keypair-1685156283", "user_data": "}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:15.520324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0d9cdc55-3b4c-4d22-913a-28cda9db23e3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c4f430>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:15.577318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0d9cdc55-3b4c-4d22-913a-28cda9db23e3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062334 Jun 22 20:14:15.578974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1056/2190] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:15.583694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] validate_networks() for [('2eca3001-1b6f-4e98-983b-840dfedc59fb', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:14:16.359086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:14:16.359504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:14:16.359967 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:14:16.360384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:14:16.360790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:14:16.370239 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:16.370676 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:16.371462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:16.372088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:16.391843 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:14:16.401664 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Getting quotas for user 1300250a083246a3a82aed557846cb89 and project 5a43bb2d9dc548d2919c43284ad006b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:14:16.422724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:14:16.425319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:14:16.484533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1a0d3f8-025a-47ac-8d0e-a6216db576ee tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.021215 Jun 22 20:14:16.491351 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1135/2191] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:14:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 20:14:16.500129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-17e8f149-2b88-4c10-a0aa-23013578a19b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:16.500129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-17e8f149-2b88-4c10-a0aa-23013578a19b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:16.592417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bcb26fae-ce9c-4734-986e-c27708e21712 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b5baf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:16.602354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-17e8f149-2b88-4c10-a0aa-23013578a19b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:16.617298 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-17e8f149-2b88-4c10-a0aa-23013578a19b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1237 microversion: 2.1 time: 0.124484 Jun 22 20:14:16.618418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1057/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:16 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1237 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:16.661449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bcb26fae-ce9c-4734-986e-c27708e21712 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.074376 Jun 22 20:14:16.662435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1136/2193] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:17.634306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:17.634939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:17.641534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:17.641961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:17.642978 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:17.643415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:17.673838 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3e71ce99-009a-4136-a339-0fd154ec10d9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f03a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:17.713969 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:17.722219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3e71ce99-009a-4136-a339-0fd154ec10d9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052926 Jun 22 20:14:17.722848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1137/2194] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:17.727178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-153a98d2-3499-4f83-8288-05942cfa1111 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1289 microversion: 2.1 time: 0.092119 Jun 22 20:14:17.727178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1058/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:17 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:17.951050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-de1e470d-7cb4-4dff-86f6-a22edd6f464a tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Action: 'create', calling method: .version_select at 0x7fdc1e493f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-31002292"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:18.277179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-de1e470d-7cb4-4dff-86f6-a22edd6f464a tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.486306 Jun 22 20:14:18.277991 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1059/2196] 10.222.0.26 () {60 vars in 1154 bytes} [Wed Jun 22 20:14:17 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 20:14:18.291421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f3b787db-cf18-446d-944a-cd30658b5122 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19baa9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:18.350771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f3b787db-cf18-446d-944a-cd30658b5122 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 200 len: 343 microversion: 2.1 time: 0.065599 Jun 22 20:14:18.351464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1138/2197] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:18 2022] GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:18.735329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-952f2411-6328-4ad2-b420-68084205b2fc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4b0af0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:18.740300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:18.740981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:18.748292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:18.748876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:18.749633 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:18.750129 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:18.789587 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-952f2411-6328-4ad2-b420-68084205b2fc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058532 Jun 22 20:14:18.790257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1060/2198] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:18.909296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:18.918783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-da2f243b-54fc-4e72-8505-00baa84aa959 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.182935 Jun 22 20:14:18.919369 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1139/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:18 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:19.363529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dd8ccbbf-e2d3-4cbf-acb2-c8af95f93af0 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19d2ca60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.427912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dd8ccbbf-e2d3-4cbf-acb2-c8af95f93af0 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 200 len: 344 microversion: 2.1 time: 0.068924 Jun 22 20:14:19.428607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1061/2200] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:19.441132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f4ce0294-7c61-48e8-85da-293555bb5773 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Action: 'create', calling method: .version_select at 0x7fdc19baadc0>, body: {"snapshot": {"volume_id": "320fdb78-809e-4adc-99e6-9df5f092a043", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1716913915"}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:19.692987 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f4ce0294-7c61-48e8-85da-293555bb5773 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.256095 Jun 22 20:14:19.694126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1140/2201] 10.222.0.26 () {60 vars in 1161 bytes} [Wed Jun 22 20:14:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:19.703535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-af8a342a-5369-4ed6-9042-23902b2f2891 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc1b1ae820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.761813 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-af8a342a-5369-4ed6-9042-23902b2f2891 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.061878 Jun 22 20:14:19.776749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1062/2202] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:19.785026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c2a8e51c-8280-4514-9b0c-257aa6b202b7 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19f440d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.846267 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c2a8e51c-8280-4514-9b0c-257aa6b202b7 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.068537 Jun 22 20:14:19.852580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1063/2203] 10.222.0.26 () {58 vars in 1139 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:19.854485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dfc213df-10ab-42c0-a1d3-3fadbdd655ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2c940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.889812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-a3f5756c-beac-434e-8c11-4cf08bcdba00 req-0c65ac80-145b-41c7-acc5-132d35fd9f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bf62ec-5317-46ec-b590-2f1f3f137b76", "tag": "047ad7c0-a29f-4ca1-ae40-640948b830ae"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:19.903274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-a3f5756c-beac-434e-8c11-4cf08bcdba00 req-0c65ac80-145b-41c7-acc5-132d35fd9f24 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:19.904022 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-a3f5756c-beac-434e-8c11-4cf08bcdba00 req-0c65ac80-145b-41c7-acc5-132d35fd9f24 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:19.919634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dfc213df-10ab-42c0-a1d3-3fadbdd655ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.068766 Jun 22 20:14:19.920675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-a3f5756c-beac-434e-8c11-4cf08bcdba00 req-0c65ac80-145b-41c7-acc5-132d35fd9f24 service nova] Creating event network-changed:047ad7c0-a29f-4ca1-ae40-640948b830ae for instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 on hv-cinder-84721 Jun 22 20:14:19.921274 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1064/2204] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:19.928000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7240d454-60aa-4485-bc55-7dd2a911dcea tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19d2c9d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.929162 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-a3f5756c-beac-434e-8c11-4cf08bcdba00 req-0c65ac80-145b-41c7-acc5-132d35fd9f24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194228 Jun 22 20:14:19.931944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1141/2205] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:19.945885 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:19.946595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:19.953469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:19.953933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:19.954671 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:19.955224 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:19.964161 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7240d454-60aa-4485-bc55-7dd2a911dcea tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.041621 Jun 22 20:14:19.964743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1065/2206] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:20.098476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:20.106468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5a5927b5-d9bc-416c-ba75-4d813fd5797a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.173127 Jun 22 20:14:20.107091 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1142/2207] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:19 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:20.933646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-524b3895-c747-4c1b-a030-d3a88640f465 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:20.976340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-50517f17-a799-46fe-b886-bd28f6f90867 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19baa670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:20.981142 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-524b3895-c747-4c1b-a030-d3a88640f465 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051891 Jun 22 20:14:20.981756 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1066/2208] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:21.006705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-50517f17-a799-46fe-b886-bd28f6f90867 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.034695 Jun 22 20:14:21.007304 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1143/2209] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:20 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:21.124758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:21.125431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:21.132945 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:21.133324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:21.134089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:21.134520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:21.266354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:21.274042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7ef48521-8f8e-4d99-ab26-45bcb2e2f4cb tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.153620 Jun 22 20:14:21.274608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1067/2210] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:21 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:21.993855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0d051bae-c4b5-462f-8854-5446e8f1f55e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ddc9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:22.018789 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-791e39a6-9183-48e2-bc3e-605623e8fa18 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19c7e4c0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:22.041989 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0d051bae-c4b5-462f-8854-5446e8f1f55e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052491 Jun 22 20:14:22.042548 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1144/2211] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:22.049509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-791e39a6-9183-48e2-bc3e-605623e8fa18 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.034603 Jun 22 20:14:22.050088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1068/2212] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:22 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:22.295591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:22.296668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:22.304607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:22.305053 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:22.305836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:22.306265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:22.440288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:22.448079 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a220e907-4e10-4b76-a4ed-192f7e3ddf78 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.159033 Jun 22 20:14:22.448680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1145/2213] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:22 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:23.055287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-347fb3ac-0eee-4df3-b85d-5335a2fe016c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1c10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:23.061198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c630ed43-61f6-4c37-a100-2f1d580051c1 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19ddc280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:23.096085 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c630ed43-61f6-4c37-a100-2f1d580051c1 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.038616 Jun 22 20:14:23.096738 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1146/2214] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:23 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:23.102870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-347fb3ac-0eee-4df3-b85d-5335a2fe016c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051852 Jun 22 20:14:23.103451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1069/2215] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:23.465641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:23.466677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:23.473307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:23.473759 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:23.474550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:23.474966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:23.610814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:23.622320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d6b7294d-1399-44ca-951b-f61fd0eee777 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.160265 Jun 22 20:14:23.623024 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1147/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:23 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:24.108706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3cdeed9d-9e4e-4923-9af2-084cb60fb1ad tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19c0f1f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:24.114691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb1f9680-d56a-447c-bcc2-667ca2aba1b9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e134c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:24.139939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3cdeed9d-9e4e-4923-9af2-084cb60fb1ad tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.035555 Jun 22 20:14:24.140601 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1070/2217] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:24 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:24.162219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb1f9680-d56a-447c-bcc2-667ca2aba1b9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051253 Jun 22 20:14:24.162791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1148/2218] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:24.644602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:24.645562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:24.653202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:24.653652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:24.654533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:24.655037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:24.789882 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:24.801424 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0dd03481-5ba5-4a8a-88c7-dd2f66c48a75 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.163063 Jun 22 20:14:24.802149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1071/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:24 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:25.152639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c1c508c-fe80-4a56-bc4c-6950e6b5ba01 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19bea820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:25.174740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-472be0ba-ee5c-40a7-9cd1-61cab3a73dc3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1ae040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:25.183393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c1c508c-fe80-4a56-bc4c-6950e6b5ba01 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 288 microversion: 2.1 time: 0.035079 Jun 22 20:14:25.183929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1149/2220] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:25 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:25.193791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-95e749c7-7cb2-45c4-9c9f-70fc97298d64 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc1e3f0280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:25.223036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-472be0ba-ee5c-40a7-9cd1-61cab3a73dc3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052123 Jun 22 20:14:25.223621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1072/2221] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:25.257392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-95e749c7-7cb2-45c4-9c9f-70fc97298d64 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 202 len: 0 microversion: 2.1 time: 0.067085 Jun 22 20:14:25.257970 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1150/2222] 10.222.0.26 () {58 vars in 1253 bytes} [Wed Jun 22 20:14:25 2022] DELETE /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:14:25.266537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-23900070-cf9e-48b0-94df-b199461db200 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19be1160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:25.295708 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-23900070-cf9e-48b0-94df-b199461db200 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.033171 Jun 22 20:14:25.296356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1073/2223] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:25 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:25.822625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:25.823636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:25.834515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:25.835207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:25.835984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:25.836450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:25.974264 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:25.982038 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3ae1a302-6db5-4316-8feb-ab4b715ebc07 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.166066 Jun 22 20:14:25.982581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1151/2224] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:25 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:26.235606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a98d8dc1-f80f-4cdd-8952-2fe10fe68bcf tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d43550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:26.283118 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a98d8dc1-f80f-4cdd-8952-2fe10fe68bcf tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051842 Jun 22 20:14:26.283690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1074/2225] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:26.309427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3d358033-8973-417a-9119-e137bb724208 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19d80280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:26.343716 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3d358033-8973-417a-9119-e137bb724208 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.040610 Jun 22 20:14:26.344590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1152/2226] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:26 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:26.999049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:27.003224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:27.003833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:27.010712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:27.011167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:27.011933 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:27.012399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:27.150203 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:27.158294 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-249dbea9-018a-44e9-bdea-c3d984ee00a8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.159951 Jun 22 20:14:27.158854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1075/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:26 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:27.292276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:27.293064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:27.297277 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8085115f-af45-4997-96d2-eda83707a46a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bea820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:27.350048 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8085115f-af45-4997-96d2-eda83707a46a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058252 Jun 22 20:14:27.350674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1153/2228] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:27.356511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-591bfce4-38ed-4f7d-b53e-0f71030d538f tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19d2c3a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:27.393165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-591bfce4-38ed-4f7d-b53e-0f71030d538f tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.040453 Jun 22 20:14:27.393850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1076/2229] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:27 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:28.179040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:28.179934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:28.187810 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:28.188292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:28.189060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:28.189483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:28.321740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:28.329695 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-76283b5f-6639-4130-840f-f89107ec865a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.157310 Jun 22 20:14:28.330246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1154/2230] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:28 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:28.362811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1e79997b-9062-4228-9c7f-d77e02fc41d1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7ef70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:28.406562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8a3255ee-39dd-4c80-a252-387234adf46c tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19d809d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:28.420677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1e79997b-9062-4228-9c7f-d77e02fc41d1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061625 Jun 22 20:14:28.421450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1077/2231] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:28.437154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8a3255ee-39dd-4c80-a252-387234adf46c tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.035445 Jun 22 20:14:28.437714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1155/2232] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:28 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:29.350912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:29.352040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:29.359795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:29.360448 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:29.361024 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:29.361451 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:29.433472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5fe6a986-869b-4ff8-af70-b1e98a73baaf tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b5b430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:29.487965 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5fe6a986-869b-4ff8-af70-b1e98a73baaf tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058855 Jun 22 20:14:29.488666 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1156/2233] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:29.493184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b74ef045-a664-4b89-9d24-c4187cb77caa tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19bae820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:29.507589 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:29.515520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8d4bcc06-355e-4e8a-ad27-ca2f82610bb0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.170980 Jun 22 20:14:29.516057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1078/2234] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:29 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:29.523244 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b74ef045-a664-4b89-9d24-c4187cb77caa tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 200 len: 287 microversion: 2.1 time: 0.033497 Jun 22 20:14:29.523867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1157/2235] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:29 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:29.980673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1141203854", "imageRef": "94f9e261-a5f4-4fcb-a51c-91a851baa63d", "flavorRef": "452", "networks": [{"uuid": "a277d569-eec0-496a-907f-dbef3e537693"}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:30.030908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] validate_networks() for [('a277d569-eec0-496a-907f-dbef3e537693', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:14:30.500991 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fd2e75c8-ff32-414c-954d-e41d195d2f10 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d809d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:30.552900 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fd2e75c8-ff32-414c-954d-e41d195d2f10 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056308 Jun 22 20:14:30.553725 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1158/2236] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:30.564298 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:30.565007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:30.571323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:30.572473 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:30.573456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:30.573912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:30.713566 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:30.721449 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-585dcd98-51ed-40b9-9764-54e8071b71f0 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.162069 Jun 22 20:14:30.722042 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1159/2237] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:30 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:30.726637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-94b17c16-ac4f-4596-9fef-e279c8b80791 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19e57430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:30.752742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-94b17c16-ac4f-4596-9fef-e279c8b80791 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] HTTP exception thrown: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-94b17c16-ac4f-4596-9fef-e279c8b80791 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Request method failure captured: Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 HTTP/1.1 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3gZAYB3qqKns2PPExgom2pbzyIZNy-d2KMtNt5bGmqITXenV3Godfsi1f_KT5yrLSbp6M_r59k0zkN2tKT-JbM2mFOvnuOD9Gr4HUyamNnHkDO_a5lGgsbWPE1zlde0K-UJiuLUQpwvxyf4KOAeyiK2Ot9Gi-nU_rr1IczTPOMu4e8 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:14:30.755076 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c4513aee54341f7877c8ebe03fdccde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: b1ff59e63d164040920602d13b3a6e9c Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4'} Jun 22 20:14:30.757123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. (HTTP 404) (Request-ID: req-f3112ffd-3acb-4924-a08a-a304ac7d10bf) Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.758491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:30.760372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 20:14:30.761974 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-94b17c16-ac4f-4596-9fef-e279c8b80791 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Returning 404 to user: Snapshot 07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:30.763864 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-94b17c16-ac4f-4596-9fef-e279c8b80791 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4" status: 404 len: 111 microversion: 2.1 time: 0.033473 Jun 22 20:14:30.765054 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1160/2238] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jun 22 20:14:30 2022] GET /compute/v2.1/os-snapshots/07a2f7a8-d2df-40da-8e22-ac1d6f4bb2b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:14:30.765907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5503d8a9-be24-4487-af9f-232c5e40cec8 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19bae670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:30.831136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5503d8a9-be24-4487-af9f-232c5e40cec8 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 202 len: 0 microversion: 2.1 time: 0.068990 Jun 22 20:14:30.832286 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1161/2239] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 20:14:30 2022] DELETE /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:14:30.840319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c39f50a9-fe97-429e-bca1-a6bf260921e1 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc1e3f0af0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:30.894877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c39f50a9-fe97-429e-bca1-a6bf260921e1 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 200 len: 343 microversion: 2.1 time: 0.058349 Jun 22 20:14:30.895451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1162/2240] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:30 2022] GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 343 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:31.057028 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:14:31.057541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:14:31.057936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:14:31.058379 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:14:31.058853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:14:31.070940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:31.071391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:31.072224 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:31.072661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:31.094869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Getting quotas for project 5fe1d31b14ef4035ae28d659c0fa7c92. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:14:31.099765 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Getting quotas for user 216e06ca9042475b8424a4e8ad7f0ab3 and project 5fe1d31b14ef4035ae28d659c0fa7c92. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:14:31.111123 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:14:31.113518 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94f9e261-a5f4-4fcb-a51c-91a851baa63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:14:31.159233 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a04b74b2-a168-4f38-96f5-120a174ecf97 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182520 Jun 22 20:14:31.159984 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1079/2241] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 20:14:31.171420 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dc506bfd-3246-47a7-8fba-3559e4760852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:31.172300 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dc506bfd-3246-47a7-8fba-3559e4760852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:31.236215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dc506bfd-3246-47a7-8fba-3559e4760852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:31.244951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dc506bfd-3246-47a7-8fba-3559e4760852 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1219 microversion: 2.1 time: 0.078281 Jun 22 20:14:31.245550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1163/2242] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:31 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:31.565728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-127b453f-6dc2-4faa-8c5b-4eeb15b71572 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0f790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:31.613836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-127b453f-6dc2-4faa-8c5b-4eeb15b71572 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052533 Jun 22 20:14:31.614416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1080/2243] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:31.737906 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:31.738741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:31.748057 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:31.748649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:31.749533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:31.750156 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:31.890755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:31.898702 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55b0f42e-fa24-4e64-b15b-8619a2445b16 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.164876 Jun 22 20:14:31.899257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1164/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:31 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:31.908143 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0a2807a-5ac0-4c9e-a6bf-71f834ba4bbd tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19be1700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:31.937253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-c0a2807a-5ac0-4c9e-a6bf-71f834ba4bbd tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] HTTP exception thrown: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0a2807a-5ac0-4c9e-a6bf-71f834ba4bbd tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Request method failure captured: Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 HTTP/1.1 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3gZAYB3qqKns2PPExgom2pbzyIZNy-d2KMtNt5bGmqITXenV3Godfsi1f_KT5yrLSbp6M_r59k0zkN2tKT-JbM2mFOvnuOD9Gr4HUyamNnHkDO_a5lGgsbWPE1zlde0K-UJiuLUQpwvxyf4KOAeyiK2Ot9Gi-nU_rr1IczTPOMu4e8 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:14:31.939107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c4513aee54341f7877c8ebe03fdccde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: b1ff59e63d164040920602d13b3a6e9c Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '320fdb78-809e-4adc-99e6-9df5f092a043'} Jun 22 20:14:31.949873 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. (HTTP 404) (Request-ID: req-751f582e-78ff-4e46-9b6a-aeb6aed36592) Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.950981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:31.952377 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 20:14:31.953794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0a2807a-5ac0-4c9e-a6bf-71f834ba4bbd tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Returning 404 to user: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c0a2807a-5ac0-4c9e-a6bf-71f834ba4bbd tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 404 len: 109 microversion: 2.1 time: 0.037103 Jun 22 20:14:31.955129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1081/2245] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:31 2022] GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:14:31.957123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67e75816-cc13-4c03-a6b6-8b1665a6f7cb tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19beadc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:31.984478 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-67e75816-cc13-4c03-a6b6-8b1665a6f7cb tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] HTTP exception thrown: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67e75816-cc13-4c03-a6b6-8b1665a6f7cb tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Request method failure captured: Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 HTTP/1.1 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3gZAYB3qqKns2PPExgom2pbzyIZNy-d2KMtNt5bGmqITXenV3Godfsi1f_KT5yrLSbp6M_r59k0zkN2tKT-JbM2mFOvnuOD9Gr4HUyamNnHkDO_a5lGgsbWPE1zlde0K-UJiuLUQpwvxyf4KOAeyiK2Ot9Gi-nU_rr1IczTPOMu4e8 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:14:31.988384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c4513aee54341f7877c8ebe03fdccde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: b1ff59e63d164040920602d13b3a6e9c Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '320fdb78-809e-4adc-99e6-9df5f092a043'} Jun 22 20:14:31.990191 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. (HTTP 404) (Request-ID: req-622b7fec-3d83-4899-890b-0c24a22d3b72) Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.994339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 20:14:31.995706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 20:14:31.997157 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-67e75816-cc13-4c03-a6b6-8b1665a6f7cb tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Returning 404 to user: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:31.998651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-67e75816-cc13-4c03-a6b6-8b1665a6f7cb tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 404 len: 109 microversion: 2.1 time: 0.038951 Jun 22 20:14:32.000000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1165/2246] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 20:14:31 2022] DELETE /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:14:32.006083 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-564b182b-773f-42d9-b63a-1e8aac56ddb4 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Calling method '.version_select at 0x7fdc19c0fe50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:32.035557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-564b182b-773f-42d9-b63a-1e8aac56ddb4 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] HTTP exception thrown: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-564b182b-773f-42d9-b63a-1e8aac56ddb4 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Request method failure captured: Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 HTTP/1.1 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3gZAYB3qqKns2PPExgom2pbzyIZNy-d2KMtNt5bGmqITXenV3Godfsi1f_KT5yrLSbp6M_r59k0zkN2tKT-JbM2mFOvnuOD9Gr4HUyamNnHkDO_a5lGgsbWPE1zlde0K-UJiuLUQpwvxyf4KOAeyiK2Ot9Gi-nU_rr1IczTPOMu4e8 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:14:32.037727 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c4513aee54341f7877c8ebe03fdccde", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c4513aee54341f7877c8ebe03fdccde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 1c4513aee54341f7877c8ebe03fdccde Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1295597940 Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: b1ff59e63d164040920602d13b3a6e9c Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1295597940-project Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '320fdb78-809e-4adc-99e6-9df5f092a043'} Jun 22 20:14:32.039465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. (HTTP 404) (Request-ID: req-67b36453-9c8e-4daa-bd02-da1f3717c695) Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:32.040655 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 20:14:32.042162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 20:14:32.043471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-564b182b-773f-42d9-b63a-1e8aac56ddb4 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] Returning 404 to user: Volume 320fdb78-809e-4adc-99e6-9df5f092a043 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-564b182b-773f-42d9-b63a-1e8aac56ddb4 tempest-VolumesSnapshotsTestJSON-1295597940 tempest-VolumesSnapshotsTestJSON-1295597940-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043" status: 404 len: 109 microversion: 2.1 time: 0.038884 Jun 22 20:14:32.044907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1082/2247] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:32 2022] GET /compute/v2.1/os-volumes/320fdb78-809e-4adc-99e6-9df5f092a043 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:14:32.262442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:32.263352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:32.274329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:32.276500 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:32.277412 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:32.280128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:32.376739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:32.386240 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-be0e0d9e-78fc-4bb5-9b42-9540972fcd74 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1289 microversion: 2.1 time: 0.127759 Jun 22 20:14:32.390619 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1166/2248] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:32 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:32.626516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-089b8897-9819-498b-8a61-48311eb52a7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:32.676293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-089b8897-9819-498b-8a61-48311eb52a7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053962 Jun 22 20:14:32.677313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1083/2249] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:32 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:32.919149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:32.920016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:32.928999 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:32.929453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:32.932011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:32.932416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:33.121084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:33.129117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-914597d3-24da-46ba-8b9f-b1a9e1cd694b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.216641 Jun 22 20:14:33.129910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1167/2250] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:32 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:33.403248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:33.404087 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:33.411151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:33.411808 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:33.412608 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:33.413204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:33.642198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:33.650985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c684ee74-fe25-41c6-a582-40ff3dcecb6c tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.251446 Jun 22 20:14:33.652045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1084/2251] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:33 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:33.688826 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d6a24242-4a32-472f-896b-73128093e392 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:33.740992 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d6a24242-4a32-472f-896b-73128093e392 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056054 Jun 22 20:14:33.742276 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1168/2252] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:33.877492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-119fdf8c-f0c2-417b-b7e8-74bc4bd316f7 req-83981a4f-515f-4187-aa5a-cc17285f86d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa020d0b-936a-4a6b-9371-387eeb074906", "tag": "d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:33.886811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-119fdf8c-f0c2-417b-b7e8-74bc4bd316f7 req-83981a4f-515f-4187-aa5a-cc17285f86d6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:33.887539 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-119fdf8c-f0c2-417b-b7e8-74bc4bd316f7 req-83981a4f-515f-4187-aa5a-cc17285f86d6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:33.900237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-119fdf8c-f0c2-417b-b7e8-74bc4bd316f7 req-83981a4f-515f-4187-aa5a-cc17285f86d6 service nova] Creating event network-changed:d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a for instance aa020d0b-936a-4a6b-9371-387eeb074906 on hv-cinder-84721 Jun 22 20:14:33.906502 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-119fdf8c-f0c2-417b-b7e8-74bc4bd316f7 req-83981a4f-515f-4187-aa5a-cc17285f86d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Jun 22 20:14:33.907580 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1085/2253] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:34.146894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:34.147573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:34.157920 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:34.158364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:34.159146 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:34.159584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:34.324805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:34.333513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-89899ac9-de43-4060-8625-a08d4c274406 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.190950 Jun 22 20:14:34.334303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1169/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:34 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:34.485484 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-9b099a9c-eeda-473d-876c-9e63e7c8175a req-b2ca922f-aaba-42b3-af30-284a0dd22f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bf62ec-5317-46ec-b590-2f1f3f137b76", "name": "network-vif-plugged", "status": "completed", "tag": "047ad7c0-a29f-4ca1-ae40-640948b830ae"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:34.494627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-9b099a9c-eeda-473d-876c-9e63e7c8175a req-b2ca922f-aaba-42b3-af30-284a0dd22f0f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:34.495145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-9b099a9c-eeda-473d-876c-9e63e7c8175a req-b2ca922f-aaba-42b3-af30-284a0dd22f0f service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:34.506702 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-9b099a9c-eeda-473d-876c-9e63e7c8175a req-b2ca922f-aaba-42b3-af30-284a0dd22f0f service nova] Creating event network-vif-plugged:047ad7c0-a29f-4ca1-ae40-640948b830ae for instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 on hv-cinder-84721 Jun 22 20:14:34.511705 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-9b099a9c-eeda-473d-876c-9e63e7c8175a req-b2ca922f-aaba-42b3-af30-284a0dd22f0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188766 Jun 22 20:14:34.513303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1086/2255] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:34.668569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:34.669429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:34.678823 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:34.679291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:34.680140 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:34.680577 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:34.755821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-833c584e-8579-469b-bded-09f805cfb3e6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:34.807278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-833c584e-8579-469b-bded-09f805cfb3e6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056061 Jun 22 20:14:34.807901 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1087/2256] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:34.857269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:34.865055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-91305bed-fffb-447d-9e82-ee5698112976 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.200819 Jun 22 20:14:34.865699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1170/2257] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:34 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:35.354926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:35.355953 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:35.365010 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:35.365537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:35.366568 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:35.367144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:35.520145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:35.527877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d804f4f8-371f-4896-80c4-80e73fa5530a tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.179406 Jun 22 20:14:35.528481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1088/2258] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:35 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:35.820133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5538ae14-f5c0-464b-abb9-c7ba1f870e5a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ddc940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:35.872807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5538ae14-f5c0-464b-abb9-c7ba1f870e5a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056702 Jun 22 20:14:35.873421 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1171/2259] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:35.881585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:35.882201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:35.890005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:35.890458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:35.891238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:35.891806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:36.042906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:36.050526 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7d90f693-0f60-4249-b153-5b865cf67bfd tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.172849 Jun 22 20:14:36.051094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1089/2260] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:35 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:36.548924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:36.549855 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:36.559533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:36.559981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:36.560805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:36.561290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:36.708182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:36.717432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6c753c1a-20f2-4d67-8118-e1422af0691d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.175188 Jun 22 20:14:36.718025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1172/2261] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:36 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:36.886002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f1298633-0d54-4562-9a25-07c7f111ee9e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:36.933092 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f1298633-0d54-4562-9a25-07c7f111ee9e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051085 Jun 22 20:14:36.933673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1090/2262] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:37.067981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:37.068758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:37.075927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:37.076625 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:37.077543 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:37.078082 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:37.215316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:37.223310 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e8238c62-e271-47de-880b-12c810c1bae0 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.160030 Jun 22 20:14:37.224188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1173/2263] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:37 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:37.734586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:37.735171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:37.741670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:37.742148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:37.742912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:37.743342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:37.947403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5281d5ef-b891-415b-99a4-3b6cd838237c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:37.947603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:37.955672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42d81231-bc9d-4f6d-9503-d744a91c43be tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1363 microversion: 2.1 time: 0.225094 Jun 22 20:14:37.957172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1091/2264] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:37 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:38.005824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5281d5ef-b891-415b-99a4-3b6cd838237c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063881 Jun 22 20:14:38.011895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1174/2265] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:38.250191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:38.250821 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:38.257210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:38.257760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:38.258809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:38.259471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:38.425841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:38.434141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9ca19816-0487-4156-9d26-ee8a64155c49 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.196903 Jun 22 20:14:38.434715 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1092/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:38 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:38.976315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:38.976923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:38.983708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:38.984185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:38.984951 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:38.985378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:38.990743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=100 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:39.018382 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b532558d-a2ab-4e27-8f42-aa26b1148de5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:39.074351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b532558d-a2ab-4e27-8f42-aa26b1148de5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059870 Jun 22 20:14:39.074844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1093/2267] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:39.121731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:39.129154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f0e32ccd-cb4e-4d6e-9361-c38722e0960e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1549 microversion: 2.1 time: 0.159776 Jun 22 20:14:39.129709 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1175/2268] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:38 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:39.145806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:39.146293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:39.152774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:39.153217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:39.153974 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:39.154395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:39.233566 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aa7864e0-2177-4dcf-8e6e-ee2d22922256 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091527 Jun 22 20:14:39.235036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1094/2269] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jun 22 20:14:39 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:39.452503 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:39.453427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:39.460902 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:39.461576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:39.462362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:39.462797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:39.743086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:39.752986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-133ece67-5f3b-440d-a47b-8772e5ad9538 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.305451 Jun 22 20:14:39.754442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1176/2270] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:39 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:40.087145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b42851bd-2f7b-4d70-9fab-299271839abc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d43940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:40.146853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b42851bd-2f7b-4d70-9fab-299271839abc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063984 Jun 22 20:14:40.152033 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1095/2271] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:40.327571 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-21e8c0bf-9ad2-4799-9c44-f8cac9a40a87 req-7ad9cb71-f197-4d13-a69a-31b744e0caf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa020d0b-936a-4a6b-9371-387eeb074906", "name": "network-vif-plugged", "status": "completed", "tag": "d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:40.332165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:40.349687 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-21e8c0bf-9ad2-4799-9c44-f8cac9a40a87 req-7ad9cb71-f197-4d13-a69a-31b744e0caf1 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:40.350416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-21e8c0bf-9ad2-4799-9c44-f8cac9a40a87 req-7ad9cb71-f197-4d13-a69a-31b744e0caf1 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:40.369069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-21e8c0bf-9ad2-4799-9c44-f8cac9a40a87 req-7ad9cb71-f197-4d13-a69a-31b744e0caf1 service nova] Creating event network-vif-plugged:d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a for instance aa020d0b-936a-4a6b-9371-387eeb074906 on hv-cinder-84721 Jun 22 20:14:40.375307 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-21e8c0bf-9ad2-4799-9c44-f8cac9a40a87 req-7ad9cb71-f197-4d13-a69a-31b744e0caf1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051530 Jun 22 20:14:40.376197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1177/2272] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:40.668689 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-346a0602-72ac-4f86-9898-3ace83294530 req-d71339ef-163a-4c4a-b30a-fa769d3ae5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bf62ec-5317-46ec-b590-2f1f3f137b76", "tag": "047ad7c0-a29f-4ca1-ae40-640948b830ae"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:40.677068 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:40.680124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-346a0602-72ac-4f86-9898-3ace83294530 req-d71339ef-163a-4c4a-b30a-fa769d3ae5f6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:40.680961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-346a0602-72ac-4f86-9898-3ace83294530 req-d71339ef-163a-4c4a-b30a-fa769d3ae5f6 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:40.686959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=83 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:40.701316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-346a0602-72ac-4f86-9898-3ace83294530 req-d71339ef-163a-4c4a-b30a-fa769d3ae5f6 service nova] Creating event network-changed:047ad7c0-a29f-4ca1-ae40-640948b830ae for instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 on hv-cinder-84721 Jun 22 20:14:40.707780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-346a0602-72ac-4f86-9898-3ace83294530 req-d71339ef-163a-4c4a-b30a-fa769d3ae5f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221074 Jun 22 20:14:40.709126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1096/2273] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:40.770854 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:40.771935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:40.786142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:40.786618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:40.787409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:40.788230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:40.955710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:40.964600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-541865e1-cb9e-45e6-ac41-441099450b71 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.197687 Jun 22 20:14:40.965392 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1178/2274] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:40 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:41.156237 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:41.157817 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:41.168691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-202ed2bd-2008-4943-a1fa-5f40695743b0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7af70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:41.276065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-202ed2bd-2008-4943-a1fa-5f40695743b0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.120960 Jun 22 20:14:41.276863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1097/2275] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:41.982123 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:41.982930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:41.985275 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:41.991672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:41.992148 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:41.993142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:41.993518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:42.148831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:42.159215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7441d61c-c6c0-41c4-9206-e4bbf9e12589 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1319 microversion: 2.1 time: 0.181181 Jun 22 20:14:42.159804 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1179/2276] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:41 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:14:42.289140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b2faea7f-42c4-4659-ab40-c2b466f7adbd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:42.352653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b2faea7f-42c4-4659-ab40-c2b466f7adbd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.067509 Jun 22 20:14:42.353577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1098/2277] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:43.176593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:43.177210 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:43.184395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:43.184866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:43.185661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:43.186087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:43.327365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:14:43.335466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bf8b607d-ce14-4395-aca9-3c71987b3759 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1507 microversion: 2.1 time: 0.162771 Jun 22 20:14:43.336045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1180/2278] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:14:43 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:14:43.353200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a236c1a-722d-4558-ba3d-65cae165cf16", "device": "/dev/sdb"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:14:43.355111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:14:43.366939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:43.368650 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2bc8ded0-7817-465f-b8a5-53f74961c506 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:43.373967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:43.375050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:14:43.375481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:14:43.447448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2bc8ded0-7817-465f-b8a5-53f74961c506 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.085384 Jun 22 20:14:43.448249 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1181/2279] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:14:43.669704 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e2459bf-82c8-4acc-87e4-9b46e860b051 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "POST /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321179 Jun 22 20:14:43.670586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1099/2280] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 20:14:43 2022] POST /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:44.462021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f1cfea6d-1cb4-41ac-ab9e-354c0e9d3d98 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:44.517352 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f1cfea6d-1cb4-41ac-ab9e-354c0e9d3d98 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060844 Jun 22 20:14:44.517927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1182/2281] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:45.531815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-300b6eba-3310-4244-aec5-1a7da0ca9e80 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:45.583446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-300b6eba-3310-4244-aec5-1a7da0ca9e80 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057254 Jun 22 20:14:45.584741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1100/2282] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:46.597525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6052849f-91b1-4cf3-bb6b-091eede343eb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48eaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:46.657419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6052849f-91b1-4cf3-bb6b-091eede343eb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064472 Jun 22 20:14:46.657988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1183/2283] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:47.670950 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0eb073a7-c8ac-4355-9249-940d818c8d7c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7eb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:47.721854 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0eb073a7-c8ac-4355-9249-940d818c8d7c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055577 Jun 22 20:14:47.722446 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1101/2284] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:48.735142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-efb9b39a-ca8f-4116-83c0-4b5d2e87cf27 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450f70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:48.785792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-efb9b39a-ca8f-4116-83c0-4b5d2e87cf27 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055143 Jun 22 20:14:48.786568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1184/2285] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:49.800387 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9b59ae2c-57a7-4686-acf6-70e82da473c1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1a00ff70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:49.853920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9b59ae2c-57a7-4686-acf6-70e82da473c1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058748 Jun 22 20:14:49.854522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1102/2286] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:50.867801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-88974531-bdd0-4572-a765-937788ac85cd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:50.918550 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-88974531-bdd0-4572-a765-937788ac85cd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055289 Jun 22 20:14:50.919124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1185/2287] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:51.931834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5e48a06b-72c0-474f-8852-d5066d18eb57 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7eb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:51.983248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5e48a06b-72c0-474f-8852-d5066d18eb57 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055808 Jun 22 20:14:51.983836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1103/2288] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:53.001181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8f0754af-3d72-4a30-99d5-e5f669c20d54 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19beaaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:53.055223 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8f0754af-3d72-4a30-99d5-e5f669c20d54 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061647 Jun 22 20:14:53.055775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1186/2289] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:54.067726 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:54.068985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:54.075069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-30811065-68e1-4d61-91a0-cb637b3ef387 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:54.131450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-30811065-68e1-4d61-91a0-cb637b3ef387 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066071 Jun 22 20:14:54.132053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1104/2290] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:55.142775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=7 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:55.143996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=30 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:14:55.149292 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6164c29e-e242-4c56-957c-e547e41f6c88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ddc280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:55.197090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6164c29e-e242-4c56-957c-e547e41f6c88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055220 Jun 22 20:14:55.197901 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1187/2291] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:56.214982 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4ea3c6e4-6ff1-4991-a027-42defa28e06f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:56.272571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4ea3c6e4-6ff1-4991-a027-42defa28e06f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064768 Jun 22 20:14:56.273144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1105/2292] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:57.290014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9299ff04-ca13-4b88-b304-7bf0c8dc05cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48e550>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:57.348840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9299ff04-ca13-4b88-b304-7bf0c8dc05cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066224 Jun 22 20:14:57.349443 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1188/2293] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:58.366602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cca440bf-d807-48c2-964b-04f7945ac261 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe5280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:58.424871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cca440bf-d807-48c2-964b-04f7945ac261 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065635 Jun 22 20:14:58.425450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1106/2294] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:14:59.438415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-474ba426-abe8-4271-a9b8-7724ebd09b05 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:14:59.487404 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-474ba426-abe8-4271-a9b8-7724ebd09b05 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053403 Jun 22 20:14:59.487994 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1189/2295] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:14:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:00.502916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a95fe6c4-fc88-4e6c-bce8-7e24891aec9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7edc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:00.550343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a95fe6c4-fc88-4e6c-bce8-7e24891aec9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051866 Jun 22 20:15:00.550916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1107/2296] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:01.564149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b77d24f7-88cf-4de8-94be-b5a235461651 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:01.612341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b77d24f7-88cf-4de8-94be-b5a235461651 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052668 Jun 22 20:15:01.612905 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1190/2297] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:02.630127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6e435c51-a53d-4d57-92ee-9b5c55760644 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cb5700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:02.683809 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6e435c51-a53d-4d57-92ee-9b5c55760644 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061182 Jun 22 20:15:02.684423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1108/2298] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:03.697552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e2b0041a-5391-4f26-a25b-c0ea419bb154 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19eec3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:03.754177 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e2b0041a-5391-4f26-a25b-c0ea419bb154 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061085 Jun 22 20:15:03.754756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1191/2299] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:03.775200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:03.775847 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:03.782794 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:03.783248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:03.784062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:03.784527 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:03.873460 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lazy-loading 'services' on Instance uuid aa020d0b-936a-4a6b-9371-387eeb074906 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:15:03.957942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d0878be9-73e3-4baf-a795-446804a4fe52 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906/os-volume_attachments/0a236c1a-722d-4558-ba3d-65cae165cf16" status: 202 len: 0 microversion: 2.1 time: 0.187046 Jun 22 20:15:03.958513 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1109/2300] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:15:03 2022] DELETE /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906/os-volume_attachments/0a236c1a-722d-4558-ba3d-65cae165cf16 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:15:04.772241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cedc8779-25a2-43f7-b5e0-c8208c76dbf6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48e9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:04.820435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cedc8779-25a2-43f7-b5e0-c8208c76dbf6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055545 Jun 22 20:15:04.821004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1192/2301] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:05.068511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:05.069067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:05.075651 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:05.076064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:05.076867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:05.077296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:05.102272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:15:05.178131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5f6cdfb0-24b2-41b6-82dd-0409d5a80061 tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 204 len: 0 microversion: 2.1 time: 0.114010 Jun 22 20:15:05.178706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1110/2302] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:15:05 2022] DELETE /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:15:05.187001 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:05.187597 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:05.194045 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:05.194487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:05.195238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:05.195662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:05.328401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:15:05.336377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d80632f8-73f6-4499-995f-f87effd531ba tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1513 microversion: 2.1 time: 0.153405 Jun 22 20:15:05.336984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1193/2303] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:15:05 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:15:05.834321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-861b4ad4-58fd-4654-95f1-56a5fa9b9963 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:05.882420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-861b4ad4-58fd-4654-95f1-56a5fa9b9963 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052791 Jun 22 20:15:05.882995 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1111/2304] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:06.357622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:06.358581 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:06.369280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:06.369720 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:06.370490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:06.370910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:06.512781 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:15:06.520607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d609023d-a9f4-4749-9496-d11db1a316ac tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1513 microversion: 2.1 time: 0.169389 Jun 22 20:15:06.521139 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1194/2305] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:15:06 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:15:06.899968 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-28fcca2a-8bac-4869-9054-efc0db29ccca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4930d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:06.953642 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-28fcca2a-8bac-4869-9054-efc0db29ccca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060897 Jun 22 20:15:06.954211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1112/2306] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:07.541299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:07.541934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:07.548731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:07.549182 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:07.549944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:07.550378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:07.753314 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '216e06ca9042475b8424a4e8ad7f0ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1d31b14ef4035ae28d659c0fa7c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:15:07.761321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fe5500d2-dba7-4bdc-9d44-85ab7f3dbc9d tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 200 len: 1513 microversion: 2.1 time: 0.225873 Jun 22 20:15:07.761893 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1195/2307] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:15:07 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:15:07.968919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a55effee-b0d1-4659-a2cb-9d39bc6677af tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0f0d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:08.016569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a55effee-b0d1-4659-a2cb-9d39bc6677af tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052032 Jun 22 20:15:08.017217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1113/2308] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:08.138858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-186b8217-45f4-4538-a846-97c792418907 req-d22d867f-864b-423b-9042-2938f59da2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa020d0b-936a-4a6b-9371-387eeb074906", "name": "network-vif-deleted", "tag": "d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:15:08.148033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-186b8217-45f4-4538-a846-97c792418907 req-d22d867f-864b-423b-9042-2938f59da2a9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:08.148573 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-186b8217-45f4-4538-a846-97c792418907 req-d22d867f-864b-423b-9042-2938f59da2a9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:08.159975 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-186b8217-45f4-4538-a846-97c792418907 req-d22d867f-864b-423b-9042-2938f59da2a9 service nova] Creating event network-vif-deleted:d84f17ce-1b18-4aa0-b8a8-e4b80ee2eb7a for instance aa020d0b-936a-4a6b-9371-387eeb074906 on hv-cinder-84721 Jun 22 20:15:08.165130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-186b8217-45f4-4538-a846-97c792418907 req-d22d867f-864b-423b-9042-2938f59da2a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Jun 22 20:15:08.168267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1196/2309] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:08.778162 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:08.778880 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] [instance: aa020d0b-936a-4a6b-9371-387eeb074906] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:15:08.784990 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:08.785464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:08.786225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:15:08.786654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:15:08.801065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] HTTP exception thrown: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Request method failure captured: Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 HTTP/1.1 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3B7qaVy59JbjidmNQOuImk67xBDyKzw5If19jE9HWgz2AfQpBT4KQSp2s-6DT_xnRwNbLPCOfGBZdXIRxFG-ZFH28AOwhZblPl6v7uRjYCsPK_YgjU4dz3aODPSfmdX-uEqg7Ta55M6lfj6Yp1GzsbKrEgnCk4rkj6oKHIMzWYK-gk Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:15:08.802728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fe1d31b14ef4035ae28d659c0fa7c92", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fe1d31b14ef4035ae28d659c0fa7c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5fe1d31b14ef4035ae28d659c0fa7c92 Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1754436771 Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 216e06ca9042475b8424a4e8ad7f0ab3 Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-VolumesSnapshotTestJSON-1754436771-project Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. Jun 22 20:15:08.804464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'aa020d0b-936a-4a6b-9371-387eeb074906'} Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:15:08.805471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. Jun 22 20:15:08.807054 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:15:08.808423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] Returning 404 to user: Instance aa020d0b-936a-4a6b-9371-387eeb074906 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:15:08.808423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-94fdf261-0149-4c5b-b03d-4b6e4d834d7e tempest-VolumesSnapshotTestJSON-1754436771 tempest-VolumesSnapshotTestJSON-1754436771-project] 10.222.0.26 "GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906" status: 404 len: 111 microversion: 2.1 time: 0.029972 Jun 22 20:15:08.808423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1114/2310] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:15:08 2022] GET /compute/v2.1/servers/aa020d0b-936a-4a6b-9371-387eeb074906 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:15:09.031674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-da87bc46-4323-4bfe-821c-08b9a2c01313 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baab80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:09.081792 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-da87bc46-4323-4bfe-821c-08b9a2c01313 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055882 Jun 22 20:15:09.082393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1197/2311] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:10.095718 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ec6be553-9a5a-498e-9837-8f564d1a92ca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:10.147860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ec6be553-9a5a-498e-9837-8f564d1a92ca tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056761 Jun 22 20:15:10.148571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1115/2312] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:11.165206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4bf35cab-5055-495d-8081-15d6265cb6c8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:11.212703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4bf35cab-5055-495d-8081-15d6265cb6c8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054588 Jun 22 20:15:11.213247 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1198/2313] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:12.229574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cdddcfc7-d874-452b-9799-8538c9bfb266 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a8b0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:12.286057 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cdddcfc7-d874-452b-9799-8538c9bfb266 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063814 Jun 22 20:15:12.286627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1116/2314] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:13.301867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2c216e1e-4ca0-424a-a5ba-08b338df50d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450f70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:13.350273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2c216e1e-4ca0-424a-a5ba-08b338df50d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053144 Jun 22 20:15:13.350846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1199/2315] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:14.363654 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-68203ba6-d454-46c9-880e-43d8328d02fc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4933a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:14.410683 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-68203ba6-d454-46c9-880e-43d8328d02fc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051535 Jun 22 20:15:14.411211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1117/2316] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:15.424226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8ddb1784-5b43-40fd-9301-74b48b9eb2ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baab80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:15.478072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8ddb1784-5b43-40fd-9301-74b48b9eb2ad tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058307 Jun 22 20:15:15.478699 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1200/2317] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:16.490994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-aba1f713-48bd-48d4-b2de-44d6a08726d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7aa60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:16.540441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-aba1f713-48bd-48d4-b2de-44d6a08726d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053864 Jun 22 20:15:16.541229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1118/2318] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:17.554515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9974244d-125e-4b2d-99c8-493974af0ad7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19eec1f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:17.605782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9974244d-125e-4b2d-99c8-493974af0ad7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055960 Jun 22 20:15:17.606395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1201/2319] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:18.782682 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:15:18.792186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:15:18.902186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3ae76f5d-e145-435e-be1b-bcd66c1fe6e3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3eaf0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:19.082405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3ae76f5d-e145-435e-be1b-bcd66c1fe6e3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.466449 Jun 22 20:15:19.082977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1119/2320] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:20.094141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=8 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:15:20.095363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=20 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:15:20.103928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-960de1c2-d03e-4749-8b2a-5e042219ad1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:20.216450 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-960de1c2-d03e-4749-8b2a-5e042219ad1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.123831 Jun 22 20:15:20.217043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1202/2321] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:21.231573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-055246fe-f5ee-4872-a2a7-da84ca190232 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:21.282421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-055246fe-f5ee-4872-a2a7-da84ca190232 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056694 Jun 22 20:15:21.282980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1120/2322] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:22.295529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b20aa5e0-7ade-4a85-9ece-23c4487d0c28 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa8b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:22.342744 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b20aa5e0-7ade-4a85-9ece-23c4487d0c28 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051723 Jun 22 20:15:22.343305 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1203/2323] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:22 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:23.355362 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c94f29a3-6b33-480b-adf0-b1157b5be6bc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4811f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:23.402428 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c94f29a3-6b33-480b-adf0-b1157b5be6bc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051389 Jun 22 20:15:23.403002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1121/2324] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:24.415408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8e30e84d-438e-46e1-b1e3-a41a512bbbc7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:24.463472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8e30e84d-438e-46e1-b1e3-a41a512bbbc7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052363 Jun 22 20:15:24.464262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1204/2325] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:25.476758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2ba8ee84-1c98-4ad5-b273-94b036d3b57b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1c132e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:25.522844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2ba8ee84-1c98-4ad5-b273-94b036d3b57b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.050597 Jun 22 20:15:25.523411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1122/2326] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:26.540173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c53fd43-8104-4edf-9d02-a3acde05ba83 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d31160>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:26.597848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c53fd43-8104-4edf-9d02-a3acde05ba83 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065430 Jun 22 20:15:26.598417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1205/2327] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:27.611166 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-131b0ec2-4902-4faa-8361-cb3c3dda1bec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:27.657904 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-131b0ec2-4902-4faa-8361-cb3c3dda1bec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.050997 Jun 22 20:15:27.658391 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1123/2328] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:28.671293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5bfe901b-b724-4a1f-863c-4958e8694258 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd08b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:28.720136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5bfe901b-b724-4a1f-863c-4958e8694258 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053259 Jun 22 20:15:28.720736 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1206/2329] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:29.733742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ce56dd8b-11e5-4045-96d6-56e1f8176a51 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7af70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:29.782063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ce56dd8b-11e5-4045-96d6-56e1f8176a51 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052830 Jun 22 20:15:29.782633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1124/2330] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:30.795612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4d7800ae-209c-4ab7-9dd5-e3dd4c712610 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:30.842669 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4d7800ae-209c-4ab7-9dd5-e3dd4c712610 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051619 Jun 22 20:15:30.843234 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1207/2331] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:31.860661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-eb5be22f-57eb-4797-af3a-7b56a9ec4356 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2ca60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:31.913761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-eb5be22f-57eb-4797-af3a-7b56a9ec4356 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060514 Jun 22 20:15:31.914324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1125/2332] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:32.931434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fbdd4f7a-cb96-4f18-9ab8-94c72f141218 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ddc3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:32.986779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fbdd4f7a-cb96-4f18-9ab8-94c72f141218 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062680 Jun 22 20:15:32.987345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1208/2333] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:32 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:33.999861 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-df03addf-93d7-493c-8d0d-2d651e7adece tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3e550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:34.050282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-df03addf-93d7-493c-8d0d-2d651e7adece tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054806 Jun 22 20:15:34.050852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1126/2334] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:35.067487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cd3f1039-2cbf-4782-ae7b-ba0571016de9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e130d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:35.119623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cd3f1039-2cbf-4782-ae7b-ba0571016de9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058991 Jun 22 20:15:35.120418 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1209/2335] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:36.142781 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ef97d9b1-e27a-4cd3-9dc6-bf8d464fdff6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4814c0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:36.199147 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ef97d9b1-e27a-4cd3-9dc6-bf8d464fdff6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065349 Jun 22 20:15:36.200000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1127/2336] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:37.217220 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0e1b4061-0c84-45d7-871e-286695897efd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9bd30>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:37.264591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0e1b4061-0c84-45d7-871e-286695897efd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054405 Jun 22 20:15:37.265159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1210/2337] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:38.281927 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-cfd5b719-a768-47a0-b9df-ff9133fc7670 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17670>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:38.337606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-cfd5b719-a768-47a0-b9df-ff9133fc7670 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062869 Jun 22 20:15:38.338177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1128/2338] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:39.355043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e23f15f0-f426-4f78-833b-fedceb2cc2fa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:39.408801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e23f15f0-f426-4f78-833b-fedceb2cc2fa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061082 Jun 22 20:15:39.409372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1211/2339] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:40.425045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-05a51456-2926-416b-8c33-6e88a12933db tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19fe5280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:40.472364 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-05a51456-2926-416b-8c33-6e88a12933db tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051968 Jun 22 20:15:40.472936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1129/2340] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:41.485786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9efa2140-4946-4d0b-9303-46d23f69954d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd0d30>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:41.539274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9efa2140-4946-4d0b-9303-46d23f69954d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055194 Jun 22 20:15:41.539274 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1212/2341] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:42.550531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a8e1d58b-a3e4-4b59-bb38-5819f2bb8641 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7aca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:42.599638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a8e1d58b-a3e4-4b59-bb38-5819f2bb8641 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054181 Jun 22 20:15:42.600297 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1130/2342] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:43.613642 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bd7dcbe7-c0b6-4d30-93cc-e4c2e2d693f7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:43.663163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bd7dcbe7-c0b6-4d30-93cc-e4c2e2d693f7 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053997 Jun 22 20:15:43.663741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1213/2343] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:44.676249 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a57aa80f-555c-4e26-b934-b439e859a657 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:44.723805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a57aa80f-555c-4e26-b934-b439e859a657 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052019 Jun 22 20:15:44.725173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1131/2344] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:45.737990 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-279281ce-a66d-41dc-aa4c-a4f309d64a0c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48e790>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:45.791638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-279281ce-a66d-41dc-aa4c-a4f309d64a0c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058064 Jun 22 20:15:45.792723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1214/2345] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:46.807770 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d2988f61-92d2-4336-b214-6d86999448d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7aca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:46.858959 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d2988f61-92d2-4336-b214-6d86999448d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056955 Jun 22 20:15:46.859531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1132/2346] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:47.876568 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0313bcb7-2e10-43ce-a0b1-521b633c8ce0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:47.930592 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0313bcb7-2e10-43ce-a0b1-521b633c8ce0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061439 Jun 22 20:15:47.931155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1215/2347] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:48.949030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ea0c95f7-7a3e-4262-9ebd-02a31d0ba16c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34310>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:49.001313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ea0c95f7-7a3e-4262-9ebd-02a31d0ba16c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060834 Jun 22 20:15:49.001918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1133/2348] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:50.016917 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bc01049d-98f0-468c-ab94-74fad1c60909 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:50.067238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bc01049d-98f0-468c-ab94-74fad1c60909 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056899 Jun 22 20:15:50.067966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1216/2349] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:51.085535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c0099c3c-c718-4e36-a845-a79f7fc02a2d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c81c10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:51.139313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c0099c3c-c718-4e36-a845-a79f7fc02a2d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061507 Jun 22 20:15:51.139887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1134/2350] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:52.152861 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d1c9f361-28ad-4634-9edf-12e4e5b8723d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48e8b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:52.203254 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d1c9f361-28ad-4634-9edf-12e4e5b8723d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055071 Jun 22 20:15:52.204050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1217/2351] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:15:53.216936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0b023078-82de-477f-b174-0a588b564dc6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:53.269497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0b023078-82de-477f-b174-0a588b564dc6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056888 Jun 22 20:15:53.270159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1135/2352] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:54.286471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-024e9961-e3c3-41fa-8278-3a2a13d149f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd01f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:54.339485 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-024e9961-e3c3-41fa-8278-3a2a13d149f6 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060432 Jun 22 20:15:54.340062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1218/2353] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:55.356921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-859fdb3c-f5d2-4496-9236-7cb163e6af5a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19f44700>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:55.409062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-859fdb3c-f5d2-4496-9236-7cb163e6af5a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059353 Jun 22 20:15:55.409639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1136/2354] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:56.423181 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6da6df33-5e1a-44f9-95f3-ce2bc2d65ef9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:56.471524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6da6df33-5e1a-44f9-95f3-ce2bc2d65ef9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052155 Jun 22 20:15:56.471662 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1219/2355] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:57.484635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a45365d0-9be1-4ea3-8a06-6d5c6193e33b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1ae820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:57.532359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a45365d0-9be1-4ea3-8a06-6d5c6193e33b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052562 Jun 22 20:15:57.532924 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1137/2356] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:58.550095 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a3d1a0e9-268f-4512-872a-6cf4d3caf5ed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:58.602366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a3d1a0e9-268f-4512-872a-6cf4d3caf5ed tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059203 Jun 22 20:15:58.602935 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1220/2357] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:15:59.619701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-07adb72c-bd06-49a6-a792-905bdb8ece1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2cdc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:15:59.673402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-07adb72c-bd06-49a6-a792-905bdb8ece1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060935 Jun 22 20:15:59.673958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1138/2358] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:15:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:00.686928 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d84c22a1-89e9-44e4-8128-8ec4b2b0ae5e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:00.742437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d84c22a1-89e9-44e4-8128-8ec4b2b0ae5e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059948 Jun 22 20:16:00.743023 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1221/2359] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:01.755494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e79a6a49-c313-44fc-b6dc-4ae4384135a4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:01.806114 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e79a6a49-c313-44fc-b6dc-4ae4384135a4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055082 Jun 22 20:16:01.807130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1139/2360] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:02.822657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1876b08c-f3fa-4ca6-9c6a-f0901f5821f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19beaaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:02.872434 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1876b08c-f3fa-4ca6-9c6a-f0901f5821f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053949 Jun 22 20:16:02.873063 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1222/2361] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:03.889922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bfec0343-af3a-46bf-9fb1-15a817cc591b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:03.939036 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bfec0343-af3a-46bf-9fb1-15a817cc591b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056206 Jun 22 20:16:03.939609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1140/2362] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:04.954273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0916eda9-7574-49d9-a242-3b2a82f58f21 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:05.004237 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0916eda9-7574-49d9-a242-3b2a82f58f21 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055784 Jun 22 20:16:05.004799 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1223/2363] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:06.023603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4116b83c-cd28-4655-a895-e3e3061647ac tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17d30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:06.072598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4116b83c-cd28-4655-a895-e3e3061647ac tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056188 Jun 22 20:16:06.073175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1141/2364] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:07.090206 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5bbed9d9-f2fb-42fc-aea6-e194de609a17 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450940>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:07.144553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5bbed9d9-f2fb-42fc-aea6-e194de609a17 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061403 Jun 22 20:16:07.145136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1224/2365] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:08.162948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-80fa3a48-8d53-4890-975e-4db96e3e8bfc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7e9d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:08.219058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-80fa3a48-8d53-4890-975e-4db96e3e8bfc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063941 Jun 22 20:16:08.219698 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1142/2366] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:09.236943 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61085ad9-2659-4403-bcb7-23c4fce99cbe tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd0b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:09.291957 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61085ad9-2659-4403-bcb7-23c4fce99cbe tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062491 Jun 22 20:16:09.292545 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1225/2367] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:10.305047 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c5f12349-9db1-420d-9262-d1e22cd2776f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:10.354732 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c5f12349-9db1-420d-9262-d1e22cd2776f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053670 Jun 22 20:16:10.355464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1143/2368] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:11.373451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa2737ed-8a49-41d7-9ea2-7463f2dceec8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f04c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:11.429845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa2737ed-8a49-41d7-9ea2-7463f2dceec8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063226 Jun 22 20:16:11.430604 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1226/2369] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:12.448635 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-86d7d3f8-8715-4528-b801-4634ab3822a4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7e160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:12.501839 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-86d7d3f8-8715-4528-b801-4634ab3822a4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060539 Jun 22 20:16:12.502410 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1144/2370] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:13.518127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-10be4373-863b-46a6-abad-2a9c7a3dfc07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:13.570321 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-10be4373-863b-46a6-abad-2a9c7a3dfc07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059138 Jun 22 20:16:13.570892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1227/2371] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:14.588070 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d3024f8e-706c-4fbf-a990-de64ddb78936 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:14.636947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d3024f8e-706c-4fbf-a990-de64ddb78936 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056409 Jun 22 20:16:14.637509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1145/2372] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:15.653159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-890a8c27-3846-4c64-b8b0-b459b889d434 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bea3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:15.700710 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-890a8c27-3846-4c64-b8b0-b459b889d434 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054652 Jun 22 20:16:15.701284 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1228/2373] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:16.715758 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7f35066e-9a91-4d9b-839b-248ad1eb2d1a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be13a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:16.765665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7f35066e-9a91-4d9b-839b-248ad1eb2d1a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055355 Jun 22 20:16:16.766277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1146/2374] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:17.783758 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0a8e42e1-9911-4401-b204-0b50cf8929df tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d314c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:17.837680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0a8e42e1-9911-4401-b204-0b50cf8929df tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061306 Jun 22 20:16:17.838255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1229/2375] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:18.858423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-33f73a26-9791-4882-a219-7c1882987de2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2ca60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:18.912251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-33f73a26-9791-4882-a219-7c1882987de2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060244 Jun 22 20:16:18.912900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1147/2376] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:19.930159 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7e746d9a-6165-41ca-8b19-02e26f0bcd84 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e4503a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:19.981608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7e746d9a-6165-41ca-8b19-02e26f0bcd84 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058944 Jun 22 20:16:19.982179 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1230/2377] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:20.999398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0b67b425-e0df-4059-86ac-6ba012b9db87 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1c1325e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:21.058714 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0b67b425-e0df-4059-86ac-6ba012b9db87 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066445 Jun 22 20:16:21.059300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1148/2378] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:22.076380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f0cfdec2-1a4b-4fce-8a3e-eb89883451ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd09d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:22.131395 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f0cfdec2-1a4b-4fce-8a3e-eb89883451ba tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062232 Jun 22 20:16:22.131960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1231/2379] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:22 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:23.149129 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-60999f7d-a9af-468e-a5f0-da0a01647e77 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be11f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:23.210019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-60999f7d-a9af-468e-a5f0-da0a01647e77 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.068233 Jun 22 20:16:23.210596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1149/2380] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:24.229448 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-40dc2569-9a97-4c5c-8750-00fd2e735cfa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d31b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:24.288514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-40dc2569-9a97-4c5c-8750-00fd2e735cfa tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066072 Jun 22 20:16:24.289416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1232/2381] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:25.307394 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22bd091c-2104-404d-b132-809f4b8d745d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7ed30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:25.363752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22bd091c-2104-404d-b132-809f4b8d745d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064111 Jun 22 20:16:25.364374 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1150/2382] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:26.383066 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2ebca662-0a7c-4af9-b410-4caf407d1687 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:26.440560 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2ebca662-0a7c-4af9-b410-4caf407d1687 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064942 Jun 22 20:16:26.441126 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1233/2383] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:27.453919 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-44fc4452-ad80-4a72-a371-5ea128f13148 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17af0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:27.501453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-44fc4452-ad80-4a72-a371-5ea128f13148 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051838 Jun 22 20:16:27.502020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1151/2384] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:28.514661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4b823d5d-117f-4828-a440-36d0dd9f7bc5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b5bc10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:28.568078 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4b823d5d-117f-4828-a440-36d0dd9f7bc5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057748 Jun 22 20:16:28.568677 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1234/2385] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:28.952069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:28.952948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:28.961229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:28.961681 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:28.962445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:28.962887 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:28.985679 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2bfc580a-0789-4319-97ba-fa58e99c4323 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/ips" status: 200 len: 146 microversion: 2.1 time: 0.039820 Jun 22 20:16:28.986258 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1152/2386] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jun 22 20:16:28 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:29.586252 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58a6ed7b-d5cf-4123-b704-b8b558af6b9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6aaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:29.639632 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58a6ed7b-d5cf-4123-b704-b8b558af6b9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061176 Jun 22 20:16:29.640212 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1235/2387] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:30.324219 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41733540-a7e2-4a2f-8a04-8b5e32da7091"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:16:30.325396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:30.332816 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:30.333265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:30.334026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:30.334457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:30.604448 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1be67781-0387-402f-9b54-03e8182b0a3c tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284034 Jun 22 20:16:30.605080 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1153/2388] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 20:16:30 2022] POST /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:30.654668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ba4e9856-1a6b-4111-b03a-f91417044ee5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bea3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:30.702606 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ba4e9856-1a6b-4111-b03a-f91417044ee5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053289 Jun 22 20:16:30.703188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1236/2389] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:31.715967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-743742fa-76e5-45c8-b050-65222c89ab7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0faf0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:31.768973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-743742fa-76e5-45c8-b050-65222c89ab7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057356 Jun 22 20:16:31.769733 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1154/2390] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:32.784245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-882c578c-4008-41d7-b575-5068ff5425da tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bd0b80>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:32.834047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-882c578c-4008-41d7-b575-5068ff5425da tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054054 Jun 22 20:16:32.834629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1237/2391] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:32 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:33.847103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-16fff690-bba7-465c-aa69-95a32b7ec9cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c4f790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:33.893966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-16fff690-bba7-465c-aa69-95a32b7ec9cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051178 Jun 22 20:16:33.894540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1155/2392] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:34.906731 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c939bb02-6bac-4238-bd0f-80cfec0a117c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6a3a0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:34.954397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c939bb02-6bac-4238-bd0f-80cfec0a117c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052162 Jun 22 20:16:34.955311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1238/2393] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:35.970630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-daf8e36f-42ca-4239-8f8d-67594ae97ddb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c818b0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:36.015520 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-daf8e36f-42ca-4239-8f8d-67594ae97ddb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051752 Jun 22 20:16:36.016095 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1156/2394] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:37.028981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6d8ccab6-6cb9-45cb-ad33-9a427a481dec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e13dc0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:37.074618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6d8ccab6-6cb9-45cb-ad33-9a427a481dec tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.050130 Jun 22 20:16:37.075205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1239/2395] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:38.087530 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-badb62da-854b-4c46-8fa1-66a687c2bfcc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:38.135617 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-badb62da-854b-4c46-8fa1-66a687c2bfcc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052432 Jun 22 20:16:38.140481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1157/2396] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:38.159403 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:38.160483 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:38.169335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:38.169813 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:38.170590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:38.171007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:38.200295 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7421bc5c-6519-4d2c-a1c5-7d5f13b2c332 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Jun 22 20:16:38.200860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1240/2397] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:16:38 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:38.211378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:38.211980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:38.218877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:38.219312 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:38.220062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:38.220514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:38.251571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72c423e7-c1d4-4955-985f-05c3d0b21cac tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091" status: 200 len: 194 microversion: 2.1 time: 0.044135 Jun 22 20:16:38.252130 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1158/2398] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jun 22 20:16:38 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:39.152435 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3401857c-f27e-40f1-9ce2-e04e7828c798 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6af70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:39.206790 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3401857c-f27e-40f1-9ce2-e04e7828c798 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060671 Jun 22 20:16:39.207796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1241/2399] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:39 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:39.589370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41f5254f-9d22-4be3-8978-ca051eefb662"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:16:39.590495 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:39.597752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:39.598202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:39.598966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:39.599398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:39.884594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-695eceb0-e949-43d2-92c7-89bc7d4e86a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "POST /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299040 Jun 22 20:16:39.885211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1159/2400] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 20:16:39 2022] POST /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:40.225299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a0909f9a-0043-4926-8ec4-4a7559f7e401 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d315e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:40.279477 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a0909f9a-0043-4926-8ec4-4a7559f7e401 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061491 Jun 22 20:16:40.280064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1242/2401] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:41.298666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5a558f28-ae6f-4687-863d-93051c6cf4d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c810d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:41.357190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5a558f28-ae6f-4687-863d-93051c6cf4d8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066603 Jun 22 20:16:41.357769 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1160/2402] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:42.376052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fbf19193-1a43-4ff9-a462-a57e0664f6c5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e463700>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:42.439414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fbf19193-1a43-4ff9-a462-a57e0664f6c5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.071594 Jun 22 20:16:42.440209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1243/2403] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:43.457928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ece7595d-0c1e-4edf-907f-da2b4e581b9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0fdc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:43.511900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ece7595d-0c1e-4edf-907f-da2b4e581b9b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061535 Jun 22 20:16:43.512517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1161/2404] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:44.525259 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-90abd811-6432-4ada-bff6-211ff6994903 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e450f70>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:44.574982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-90abd811-6432-4ada-bff6-211ff6994903 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054071 Jun 22 20:16:44.575524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1244/2405] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:45.590640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-569be4c9-fe26-46c4-af9e-866cf2c75c6a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:45.644192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-569be4c9-fe26-46c4-af9e-866cf2c75c6a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058872 Jun 22 20:16:45.644961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1162/2406] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:46.662895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9ba6a588-c20b-4048-86a8-3fd10815eb15 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6aa60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:46.711222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9ba6a588-c20b-4048-86a8-3fd10815eb15 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056910 Jun 22 20:16:46.711795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1245/2407] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:47.446538 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:47.447586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:47.454045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.454495 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.455620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.456040 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.486893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dce7ac2e-61bb-47a1-abbe-a0db4d0ad4ec tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044886 Jun 22 20:16:47.487471 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1163/2408] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:16:47 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:47.636784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:47.637475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:47.648590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.649047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.649818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.650256 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.678971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-58df9c1e-21a2-425d-8764-c4bb2a6691f1 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091" status: 200 len: 194 microversion: 2.1 time: 0.049659 Jun 22 20:16:47.679596 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1246/2409] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jun 22 20:16:47 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:47.691722 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:47.692514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:47.701773 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.702400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.703504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:47.704180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:47.723094 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e6c69609-c40c-4d5f-9386-4e373b7b9404 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6aa60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:47.773534 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e6c69609-c40c-4d5f-9386-4e373b7b9404 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054177 Jun 22 20:16:47.774197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1247/2410] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:47.785757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lazy-loading 'services' on Instance uuid c0bf62ec-5317-46ec-b590-2f1f3f137b76 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:16:47.859324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f7c9125c-0ce2-4128-8e17-f27e7942a23d tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091" status: 202 len: 0 microversion: 2.1 time: 0.173353 Jun 22 20:16:47.859923 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1164/2411] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:16:47 2022] DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41733540-a7e2-4a2f-8a04-8b5e32da7091 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:16:48.787607 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1c417b1e-fd25-4ade-ba6d-8076e9662b87 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:48.848497 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1c417b1e-fd25-4ade-ba6d-8076e9662b87 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065463 Jun 22 20:16:48.849238 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1248/2412] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:49.867420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-793272f5-0742-4f63-800c-05e2374ad607 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e481a60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:49.916126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-793272f5-0742-4f63-800c-05e2374ad607 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056461 Jun 22 20:16:49.916690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1165/2413] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:50.036506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:50.037064 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:50.043960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:50.044433 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:50.045180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:50.045601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:50.074437 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e4d6e302-c344-4507-b444-cd1a6fbf79cf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41f5254f-9d22-4be3-8978-ca051eefb662" status: 200 len: 194 microversion: 2.1 time: 0.042367 Jun 22 20:16:50.075002 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1249/2414] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jun 22 20:16:50 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41f5254f-9d22-4be3-8978-ca051eefb662 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:50.085485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:50.086098 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:50.092832 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:50.093283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:50.094042 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:50.094473 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:50.174900 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lazy-loading 'services' on Instance uuid c0bf62ec-5317-46ec-b590-2f1f3f137b76 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:16:50.251562 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-98300aa4-431c-447e-87aa-296d9ab5c0a7 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41f5254f-9d22-4be3-8978-ca051eefb662" status: 202 len: 0 microversion: 2.1 time: 0.170116 Jun 22 20:16:50.252423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1166/2415] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:16:50 2022] DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments/41f5254f-9d22-4be3-8978-ca051eefb662 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 20:16:50.935199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7278e22c-ca69-4916-ab8a-6f1af2d62ef4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471310>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:50.986290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7278e22c-ca69-4916-ab8a-6f1af2d62ef4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057750 Jun 22 20:16:50.986871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1250/2416] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:51.432275 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:51.433378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:51.440973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.441445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.442212 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.442641 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.472485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2cd5027e-ac8a-4e4d-8cf7-8947dca3c7ab tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044639 Jun 22 20:16:51.473056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1167/2417] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:16:51 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 20:16:51.580380 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:51.581204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:51.588429 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.588880 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.589641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.590072 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.618444 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8f5a11f1-e947-4fbb-8429-df5d636509a9 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042980 Jun 22 20:16:51.619013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1251/2418] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:16:51 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 20:16:51.679606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:51.680122 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:51.686717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.687178 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.687925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.688390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.714552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:16:51.792045 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-503ea4f5-9a69-457f-bbf7-2a723ac23943 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 204 len: 0 microversion: 2.1 time: 0.116172 Jun 22 20:16:51.792711 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1168/2419] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:16:51 2022] DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 20:16:51.801428 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:51.802035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:51.808198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.808649 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.809401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:51.809834 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:51.948514 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:16:51.960829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fe99b0f9-ad61-4c14-bea7-20e814a1aec8 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1674 microversion: 2.1 time: 0.163001 Jun 22 20:16:51.961561 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1252/2420] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:16:51 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:16:51.999585 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4e4ec0f1-f600-4899-a353-41b9d966fc30 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7aa60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:52.047638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4e4ec0f1-f600-4899-a353-41b9d966fc30 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052253 Jun 22 20:16:52.048303 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1169/2421] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:52.987051 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:52.987996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:52.996328 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:52.996773 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:52.997525 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:52.997949 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:53.060256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-839dab41-75a6-4429-a3d9-e59911303e64 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:53.108787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-839dab41-75a6-4429-a3d9-e59911303e64 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052788 Jun 22 20:16:53.109396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1170/2422] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:16:53.136186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:16:53.143913 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-669027ff-6f26-498f-80a1-218a0939deaf tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1674 microversion: 2.1 time: 0.163490 Jun 22 20:16:53.144512 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1253/2423] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:16:52 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:16:54.122067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1d3dcfda-371c-4635-b2df-9248a0109328 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0faf0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:54.161043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:54.161653 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:54.167978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:54.168406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:54.169222 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:54.169590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:54.171340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1d3dcfda-371c-4635-b2df-9248a0109328 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053742 Jun 22 20:16:54.171936 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1171/2424] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:54.383370 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1300250a083246a3a82aed557846cb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a43bb2d9dc548d2919c43284ad006b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:16:54.391405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cb0ca6bf-40cd-4dd6-8694-8a4fe43a329e tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 200 len: 1674 microversion: 2.1 time: 0.234546 Jun 22 20:16:54.391985 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1254/2425] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:16:54 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:16:54.782791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-0a72c372-a41b-4b6a-bd92-b4a887ba13b4 req-44afa4fb-8ed7-48a6-ae3c-36dd3ca0b014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bf62ec-5317-46ec-b590-2f1f3f137b76", "name": "network-vif-deleted", "tag": "047ad7c0-a29f-4ca1-ae40-640948b830ae"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:16:54.786287 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:16:54.792509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-0a72c372-a41b-4b6a-bd92-b4a887ba13b4 req-44afa4fb-8ed7-48a6-ae3c-36dd3ca0b014 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:54.792952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-0a72c372-a41b-4b6a-bd92-b4a887ba13b4 req-44afa4fb-8ed7-48a6-ae3c-36dd3ca0b014 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:54.796024 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:16:54.807273 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-0a72c372-a41b-4b6a-bd92-b4a887ba13b4 req-44afa4fb-8ed7-48a6-ae3c-36dd3ca0b014 service nova] Creating event network-vif-deleted:047ad7c0-a29f-4ca1-ae40-640948b830ae for instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 on hv-cinder-84721 Jun 22 20:16:54.812652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-0a72c372-a41b-4b6a-bd92-b4a887ba13b4 req-44afa4fb-8ed7-48a6-ae3c-36dd3ca0b014 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033917 Jun 22 20:16:54.813570 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1172/2426] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:55.184464 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a555e43b-84a7-4226-abbc-9d3fa825e21e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bea820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:55.237339 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a555e43b-84a7-4226-abbc-9d3fa825e21e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056854 Jun 22 20:16:55.237982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1255/2427] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:55 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:55.411792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:55.412486 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:55.420721 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:55.421186 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:55.421955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:55.422396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:55.436540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 HTTP/1.1 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:16:55.438246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:55.440207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'c0bf62ec-5317-46ec-b590-2f1f3f137b76'} Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:16:55.441277 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:55.442898 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:55.444266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:16:55.444266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-22a15977-15e6-448a-b629-c2ef1b643275 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 404 len: 111 microversion: 2.1 time: 0.034449 Jun 22 20:16:55.444266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1173/2428] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:16:55 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:16:55.450413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-95ee3e35-051a-4bfb-ac24-132313c88bce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '.version_select at 0x7fdc19baa1f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:55.453583 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95ee3e35-051a-4bfb-ac24-132313c88bce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [4f6b6413-6cb7-4600-9566-561af4add95f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 20:16:56.254063 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-402f4c4c-ccd0-4fe3-b769-51821bfd7dc9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7af70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:56.302850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-402f4c4c-ccd0-4fe3-b769-51821bfd7dc9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055255 Jun 22 20:16:56.303412 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1174/2429] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:56.466102 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [None req-95ee3e35-051a-4bfb-ac24-132313c88bce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [4f6b6413-6cb7-4600-9566-561af4add95f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38200. Jun 22 20:16:56.497147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-95ee3e35-051a-4bfb-ac24-132313c88bce tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685156283" status: 202 len: 0 microversion: 2.1 time: 1.050682 Jun 22 20:16:56.497735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1256/2430] 10.222.0.26 () {58 vars in 1220 bytes} [Wed Jun 22 20:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685156283 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:16:57.319661 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a98ca91e-5449-4956-839b-5e4bde3c3d24 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:57.373522 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a98ca91e-5449-4956-839b-5e4bde3c3d24 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061006 Jun 22 20:16:57.374025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1175/2431] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:58.387552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1e67cd8d-c058-492d-911b-e3fd22a6872a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa280>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:58.440439 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1e67cd8d-c058-492d-911b-e3fd22a6872a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057289 Jun 22 20:16:58.440995 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1257/2432] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:16:59.406324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:59.406881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:59.414340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:59.414867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:59.415616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:59.416044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:59.429140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 HTTP/1.1 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:16:59.430659 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.432400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'c0bf62ec-5317-46ec-b590-2f1f3f137b76'} Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:16:59.433525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.435240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.437097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:16:59.437097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e3308d2a-3d5d-47ce-87a2-ac4cb4b5ef7f tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 404 len: 111 microversion: 2.1 time: 0.030447 Jun 22 20:16:59.437097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1176/2433] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:16:59 2022] DELETE /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:16:59.441065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:59.441680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: c0bf62ec-5317-46ec-b590-2f1f3f137b76] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:16:59.448582 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:59.449061 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:59.449831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:16:59.450267 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:16:59.452766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6d3191e0-f04d-474a-9816-0ca217751e37 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e5eb80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:16:59.464858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 HTTP/1.1 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:16:59.466547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.468184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'c0bf62ec-5317-46ec-b590-2f1f3f137b76'} Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:16:59.472753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. Jun 22 20:16:59.474894 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:16:59.476204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance c0bf62ec-5317-46ec-b590-2f1f3f137b76 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:16:59.476204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3c3fb974-1cf7-4c27-81f9-5c5407f7333b tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76" status: 404 len: 111 microversion: 2.1 time: 0.031400 Jun 22 20:16:59.476204 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1258/2434] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:16:59 2022] GET /compute/v2.1/servers/c0bf62ec-5317-46ec-b590-2f1f3f137b76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:16:59.505385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6d3191e0-f04d-474a-9816-0ca217751e37 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056149 Jun 22 20:16:59.505951 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1177/2435] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:16:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:00.520767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9a57d030-5bbf-4ff3-b766-5a03a36701be tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:00.571128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9a57d030-5bbf-4ff3-b766-5a03a36701be tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056813 Jun 22 20:17:00.571690 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1259/2436] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:00.605597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:00.606103 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:17:00.613146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:17:00.613595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:17:00.614357 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:17:00.614791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:17:00.627850 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 HTTP/1.1 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:17:00.629461 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.631050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '498198b2-0179-45ba-8753-15a2d61e7018'} Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:17:00.631897 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.633416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.635121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:17:00.635121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a284204f-38c6-4870-9b2e-2dcc609a7257 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jun 22 20:17:00.635121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1178/2437] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:17:00 2022] DELETE /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:17:00.639361 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:00.639983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] [instance: 498198b2-0179-45ba-8753-15a2d61e7018] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:17:00.647011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:17:00.647470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:17:00.648290 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:17:00.648766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:17:00.662012 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] HTTP exception thrown: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Request method failure captured: Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 HTTP/1.1 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis2_MjssGVv_pSFCxD0MiQCYAU0pDpDGcw_lYtuzloc8vrUAwqY9oaBEwCaYSf7d1jteP4MSqYUhKuU-OGwxpfz1B1gnuDK7siL_rMzeFiLBk6mVLHDV_xgU_Ej6jiKd_GyVYFEg4VADVT3WFHl4w6LvBVAl-l0qAamynwP0OH8TvkTE Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:17:00.663556 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a43bb2d9dc548d2919c43284ad006b2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a43bb2d9dc548d2919c43284ad006b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 5a43bb2d9dc548d2919c43284ad006b2 Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-AttachVolumeTestJSON-510182740 Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 1300250a083246a3a82aed557846cb89 Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-AttachVolumeTestJSON-510182740-project Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.665549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '498198b2-0179-45ba-8753-15a2d61e7018'} Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:17:00.666547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. Jun 22 20:17:00.668228 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:17:00.669942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] Returning 404 to user: Instance 498198b2-0179-45ba-8753-15a2d61e7018 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:17:00.669942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2300f204-f9dd-423e-b339-9b876fa9be93 tempest-AttachVolumeTestJSON-510182740 tempest-AttachVolumeTestJSON-510182740-project] 10.222.0.26 "GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018" status: 404 len: 111 microversion: 2.1 time: 0.029413 Jun 22 20:17:00.669942 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1260/2438] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:17:00 2022] GET /compute/v2.1/servers/498198b2-0179-45ba-8753-15a2d61e7018 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:17:01.586247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-80749d0e-057e-486b-9f2f-08043d0fc6d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e6f940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:01.635966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-80749d0e-057e-486b-9f2f-08043d0fc6d0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056119 Jun 22 20:17:01.636640 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1179/2439] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:02.648280 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-34bc03d5-e414-437d-a041-9ff542993d6e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e57040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:02.708213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-34bc03d5-e414-437d-a041-9ff542993d6e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063329 Jun 22 20:17:02.709326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1261/2440] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:03.723180 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f3fe297a-2546-43e8-ac33-1d16dfaff216 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c813a0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:03.802669 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f3fe297a-2546-43e8-ac33-1d16dfaff216 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.084896 Jun 22 20:17:03.803416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1180/2441] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:04.815572 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e71a40d2-c0b1-4899-b485-648b964bcb3f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:04.871766 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e71a40d2-c0b1-4899-b485-648b964bcb3f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060632 Jun 22 20:17:04.872358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1262/2442] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:05.884630 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1e39457d-13b6-455c-96b4-18ab5c547b22 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17430>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:05.932022 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1e39457d-13b6-455c-96b4-18ab5c547b22 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051106 Jun 22 20:17:05.932627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1181/2443] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:06.851004 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:17:06.851263 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:17:06.950626 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ba7630b7-6fe1-498c-845c-cc18a96fda82 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0d30>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:07.002387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ba7630b7-6fe1-498c-845c-cc18a96fda82 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060119 Jun 22 20:17:07.002922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1263/2444] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:08.019638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1a23d9d3-6a9a-4c95-931a-7108096d960e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2c9d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:08.074866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1a23d9d3-6a9a-4c95-931a-7108096d960e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062427 Jun 22 20:17:08.075423 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1182/2445] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:09.093074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b7b70113-8460-4707-9ed2-86dcffe7ce29 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b5b5e0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:09.144382 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b7b70113-8460-4707-9ed2-86dcffe7ce29 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058956 Jun 22 20:17:09.144953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1264/2446] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:10.161759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-98d8e225-8d36-4f59-8784-52f6e2f97c6f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:10.217885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-98d8e225-8d36-4f59-8784-52f6e2f97c6f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063335 Jun 22 20:17:10.218440 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1183/2447] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:11.231324 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:17:11.232575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=46 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:17:11.238740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7bfbe70c-6b03-448f-b501-a9048967775c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471ca0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:11.296895 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7bfbe70c-6b03-448f-b501-a9048967775c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.067575 Jun 22 20:17:11.297472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1265/2448] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:11 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:12.308922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=7 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:17:12.310697 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=7 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:17:12.318202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-970b6573-7aed-406f-9d43-659e101204f5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493f70>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:12.376005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-970b6573-7aed-406f-9d43-659e101204f5 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.068467 Jun 22 20:17:12.376818 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1184/2449] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:13.391445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-55033d40-8fa3-46a8-864c-79160b4480f3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b66670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:13.440032 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-55033d40-8fa3-46a8-864c-79160b4480f3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053032 Jun 22 20:17:13.440663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1266/2450] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:14.458046 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c161ad9e-10d0-44c3-b8ee-ea92d6f3ef88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c170d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:14.514208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c161ad9e-10d0-44c3-b8ee-ea92d6f3ef88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063712 Jun 22 20:17:14.514795 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1185/2451] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:14.803261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:17:14.803627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:17:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:17:15.529033 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c54eddd9-b782-44d2-894e-c70ae9d58701 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19beaaf0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:15.587724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c54eddd9-b782-44d2-894e-c70ae9d58701 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064499 Jun 22 20:17:15.588365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1267/2452] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:16.010769 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:17:16.011058 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:17:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:17:16.602144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-3b5eeca3-77ac-4f4a-a887-424fd5f6472e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c815e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:16.660075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-3b5eeca3-77ac-4f4a-a887-424fd5f6472e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063460 Jun 22 20:17:16.660787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1186/2453] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:17.673981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-95a3c8a5-74cd-4f1f-99c0-5084c3171400 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d9bc10>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:17.739417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-95a3c8a5-74cd-4f1f-99c0-5084c3171400 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.069745 Jun 22 20:17:17.740067 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1268/2454] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:17:18.755987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5182544c-a57a-49a5-b95c-8fa1da0f0187 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0f280>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:18.805516 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5182544c-a57a-49a5-b95c-8fa1da0f0187 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057086 Jun 22 20:17:18.806191 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1187/2455] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:19.821531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e3396867-1107-4b56-8e6d-aa280600908a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471ee0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:19.876372 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e3396867-1107-4b56-8e6d-aa280600908a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060585 Jun 22 20:17:19.876941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1269/2456] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:20.890359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b288c4f7-a3c3-4854-bbb4-1915b224692a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3ee50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:20.937932 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b288c4f7-a3c3-4854-bbb4-1915b224692a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051976 Jun 22 20:17:20.938490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1188/2457] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:21.951487 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a6eb9054-40ec-48a8-9292-bff0f603c5bd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f04c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:21.999910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a6eb9054-40ec-48a8-9292-bff0f603c5bd tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053123 Jun 22 20:17:22.000605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1270/2458] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:21 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:23.012576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-745e12b3-c3a4-4e6e-985f-134f98190b0a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c05670>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:23.062918 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-745e12b3-c3a4-4e6e-985f-134f98190b0a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054816 Jun 22 20:17:23.063653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1189/2459] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:23 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:24.076046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-e95cd6f5-4cd7-44f6-860a-8e8e45db661f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d50430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:24.123165 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-e95cd6f5-4cd7-44f6-860a-8e8e45db661f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051499 Jun 22 20:17:24.123735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1271/2460] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:24 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:25.135324 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-851b35d4-0381-4cca-ab44-517361eef9cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:25.191223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-851b35d4-0381-4cca-ab44-517361eef9cc tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.059966 Jun 22 20:17:25.191925 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1190/2461] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:25 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:26.206539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c5fb33ef-b2e3-4843-a817-19b69aef2590 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6a160>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:26.264034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c5fb33ef-b2e3-4843-a817-19b69aef2590 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063706 Jun 22 20:17:26.264753 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1272/2462] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:26 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:27.281146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c9e04164-e674-4c8d-8193-26fe1b10804f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c17820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:27.335235 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c9e04164-e674-4c8d-8193-26fe1b10804f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.060688 Jun 22 20:17:27.336016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1191/2463] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:27 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:28.355816 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-77528709-4aa2-430f-a930-d205ec93884d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:28.405506 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-77528709-4aa2-430f-a930-d205ec93884d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056774 Jun 22 20:17:28.406180 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1273/2464] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:28 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:28.675558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:17:28.675770 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:17:29.418948 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-da2f475f-253a-42e8-a2c9-ce36af63d2a9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c7ec10>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:29.476239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-da2f475f-253a-42e8-a2c9-ce36af63d2a9 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.061544 Jun 22 20:17:29.477051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1192/2465] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:29 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:30.490791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-75b4297e-2eb8-49ec-ae05-5c90d0b2eb7b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19baa670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:30.541837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-75b4297e-2eb8-49ec-ae05-5c90d0b2eb7b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055920 Jun 22 20:17:30.542407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1274/2466] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:30 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:31.555175 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-90d0e057-e754-4f32-9101-b208874c8c12 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d43940>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:31.604193 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-90d0e057-e754-4f32-9101-b208874c8c12 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053061 Jun 22 20:17:31.604999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1193/2467] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:31 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:32.617852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-61f3071a-6a20-4ece-b1b3-2b441c1748f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d6a430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:32.677241 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-61f3071a-6a20-4ece-b1b3-2b441c1748f0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063951 Jun 22 20:17:32.677791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1275/2468] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:32 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:33.690609 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-41baf8fe-3f27-4518-9b99-7924a4cfd89b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:33.738248 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-41baf8fe-3f27-4518-9b99-7924a4cfd89b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052306 Jun 22 20:17:33.738862 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1194/2469] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:33 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:34.751141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-aa7a255b-89eb-4ab8-9a52-fcbf1829ae1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2da60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:34.799110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-aa7a255b-89eb-4ab8-9a52-fcbf1829ae1b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052155 Jun 22 20:17:34.799847 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1276/2470] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:34 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:35.814908 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0095ea30-809f-4a94-a213-e0a0e08e9b32 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a430>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:35.866563 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0095ea30-809f-4a94-a213-e0a0e08e9b32 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057077 Jun 22 20:17:35.867139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1195/2471] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:35 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:36.881092 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4b5a41ed-044a-40b4-8282-a7f3304e6b07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c701f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:36.930311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4b5a41ed-044a-40b4-8282-a7f3304e6b07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054485 Jun 22 20:17:36.930941 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1277/2472] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:36 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:37.943521 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a777ce0-02dc-4624-bf2d-8f759b43443a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493ca0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:37.992494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0a777ce0-02dc-4624-bf2d-8f759b43443a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053302 Jun 22 20:17:37.993356 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1196/2473] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:37 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:39.005052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48cf1267-3532-44b3-83e4-de2da48cb572 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e3f0430>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:39.053185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48cf1267-3532-44b3-83e4-de2da48cb572 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052378 Jun 22 20:17:39.053743 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1278/2474] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:38 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:40.066331 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-83c61446-e27e-4e4d-9bb2-0c6f557ec2f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d3e550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:40.117481 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-83c61446-e27e-4e4d-9bb2-0c6f557ec2f4 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.055521 Jun 22 20:17:40.118055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1197/2475] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:40 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:41.135263 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9224774d-fd6a-41a3-9947-9867b3b4800b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19bae670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:41.195405 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9224774d-fd6a-41a3-9947-9867b3b4800b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.067439 Jun 22 20:17:41.196154 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1279/2476] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:41 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:42.208753 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dd33fbea-f1d8-4942-8361-24afbb9ee46c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c81d30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:42.258638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dd33fbea-f1d8-4942-8361-24afbb9ee46c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054360 Jun 22 20:17:42.263504 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1198/2477] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:42 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:43.276374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a918884e-d615-4d04-96aa-e0284defb24a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e48e9d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:43.327555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a918884e-d615-4d04-96aa-e0284defb24a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058690 Jun 22 20:17:43.328133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1280/2478] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:43 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:44.340791 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-288b24db-f3fd-4d18-aab1-1ad06546be23 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d43d30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:44.389363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-288b24db-f3fd-4d18-aab1-1ad06546be23 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053186 Jun 22 20:17:44.389943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1199/2479] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:44 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:45.403468 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1df58e65-2a30-4d43-a012-4171b0e4a2fb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2d160>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:45.451215 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1df58e65-2a30-4d43-a012-4171b0e4a2fb tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052421 Jun 22 20:17:45.452000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1281/2480] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:45 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:17:46.464201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9ce121ad-e201-4249-8cee-1f0ba91d53e2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:46.513922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9ce121ad-e201-4249-8cee-1f0ba91d53e2 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053361 Jun 22 20:17:46.514511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1200/2481] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:46 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:47.531446 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-abdf0bc7-64ec-45c6-ad75-c76c99656e11 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d50a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:47.591559 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-abdf0bc7-64ec-45c6-ad75-c76c99656e11 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.067058 Jun 22 20:17:47.592345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1282/2482] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:47 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:48.604952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d4f4b5d0-40bd-4829-8424-125b083ed338 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c4f160>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:48.653172 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d4f4b5d0-40bd-4829-8424-125b083ed338 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052489 Jun 22 20:17:48.653723 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1201/2483] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:48 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:49.666308 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c584527b-f7d4-4360-92f3-2b92cc959db3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b661f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:49.713627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c584527b-f7d4-4360-92f3-2b92cc959db3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051560 Jun 22 20:17:49.714188 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1283/2484] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:49 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:50.727359 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-72515988-59a9-42f6-9fdd-bfcd2d353569 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a0d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:50.775581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-72515988-59a9-42f6-9fdd-bfcd2d353569 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052546 Jun 22 20:17:50.776202 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1202/2485] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:50 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:51.789021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-817c8016-73b2-467c-8d12-6efbcdda0688 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2d8b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:51.837536 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-817c8016-73b2-467c-8d12-6efbcdda0688 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052688 Jun 22 20:17:51.838118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1284/2486] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:51 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:17:52.852442 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ebab913-4d62-41b2-8f5c-05021e6ff3c3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:52.900534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ebab913-4d62-41b2-8f5c-05021e6ff3c3 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052669 Jun 22 20:17:52.901146 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1203/2487] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:52 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:53.918955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-f4caece2-5c15-4a02-bd8b-0901ddcc0a23 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19caee50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:53.975840 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-f4caece2-5c15-4a02-bd8b-0901ddcc0a23 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064562 Jun 22 20:17:53.976451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1285/2488] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:53 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:54.994351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-26500d43-e494-491f-a35c-97d4f9e35420 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c0fd30>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:55.051552 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-26500d43-e494-491f-a35c-97d4f9e35420 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065330 Jun 22 20:17:55.052131 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1204/2489] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:54 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:56.064657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-167fef8b-6900-4bb5-b46f-b1c7c7277a91 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19ddc1f0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:56.115132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-167fef8b-6900-4bb5-b46f-b1c7c7277a91 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054852 Jun 22 20:17:56.115801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1286/2490] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:56 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:57.128168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b1023746-1f61-4f07-a592-bbfdb2f42d9e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e493ee0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:57.177062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b1023746-1f61-4f07-a592-bbfdb2f42d9e tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053114 Jun 22 20:17:57.177799 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1205/2491] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:57 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:58.196610 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-13b24522-25a7-4f4f-abc6-dd340ef8ac5c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19c70040>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:58.255551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-13b24522-25a7-4f4f-abc6-dd340ef8ac5c tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.066747 Jun 22 20:17:58.256199 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1287/2492] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:58 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:17:59.269503 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ce69c3f-9912-45c8-93bc-18eee4b55514 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a040>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:17:59.317173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ce69c3f-9912-45c8-93bc-18eee4b55514 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052594 Jun 22 20:17:59.317750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1206/2493] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:17:59 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:00.331944 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-697e583d-0ba6-4eb9-a0ec-a5b1c359547f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d50a60>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:00.378580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-697e583d-0ba6-4eb9-a0ec-a5b1c359547f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052476 Jun 22 20:18:00.379219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1288/2494] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:00 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:18:01.391346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4c6479ba-646b-4652-bac5-fe2c57b45da0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b34e50>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:01.441740 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4c6479ba-646b-4652-bac5-fe2c57b45da0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054442 Jun 22 20:18:01.442569 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1207/2495] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:01 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:02.455601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-896a9024-f781-49e1-985a-53b6b881587d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d318b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:02.506602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-896a9024-f781-49e1-985a-53b6b881587d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054358 Jun 22 20:18:02.507383 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1289/2496] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:02 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:03.524344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-dec4da60-a720-4a4b-9fd7-534f7a3b3a07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a0d0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:03.580227 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-dec4da60-a720-4a4b-9fd7-534f7a3b3a07 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062971 Jun 22 20:18:03.580786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1208/2497] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:03 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:04.596634 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6b710f41-9809-49fb-ac29-e04ae52e5a39 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2d670>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:04.647998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6b710f41-9809-49fb-ac29-e04ae52e5a39 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057922 Jun 22 20:18:04.648602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1290/2498] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:04 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:05.662039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8d98427c-e9bd-4e84-b96b-17c3371f4f53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b1ae820>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:05.722167 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8d98427c-e9bd-4e84-b96b-17c3371f4f53 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.064972 Jun 22 20:18:05.722739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1209/2499] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:05 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:06.737475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5a982f6c-b47e-49c2-a898-b1dde8945856 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cae820>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:06.789742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5a982f6c-b47e-49c2-a898-b1dde8945856 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.058564 Jun 22 20:18:06.790323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1291/2500] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:06 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:07.803030 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d7f0f51a-397d-4968-840b-1daf4eaf5314 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1c1325e0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:07.851879 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d7f0f51a-397d-4968-840b-1daf4eaf5314 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053187 Jun 22 20:18:07.852531 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1210/2501] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:07 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:08.865617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b11e1672-bd3f-46d5-8d79-b192a2ab5671 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471310>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:08.914230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b11e1672-bd3f-46d5-8d79-b192a2ab5671 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.053964 Jun 22 20:18:08.914805 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1292/2502] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:08 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:09.930479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-42e80e8c-656a-45a4-ae0b-6400bab2184a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:09.981573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-42e80e8c-656a-45a4-ae0b-6400bab2184a tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.057394 Jun 22 20:18:09.982192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1211/2503] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:09 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:10.995408 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9eb665de-d0dc-4d22-a225-26fc979041e0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19caee50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:11.043655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9eb665de-d0dc-4d22-a225-26fc979041e0 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.052869 Jun 22 20:18:11.044288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1293/2504] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:10 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:12.057104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-c3285018-f716-4eeb-842c-0a0085030f3d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7aa60>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:12.104627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-c3285018-f716-4eeb-842c-0a0085030f3d tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051962 Jun 22 20:18:12.105315 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1212/2505] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:12 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:13.117852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-46d3aa99-4075-47ee-8446-c1e59b936a88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2d4c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:13.165209 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-46d3aa99-4075-47ee-8446-c1e59b936a88 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051707 Jun 22 20:18:13.165787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1294/2506] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:13 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:14.182535 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-bb22cf23-0931-43bf-9d19-be5453bb8814 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19be1b80>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:14.238365 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-bb22cf23-0931-43bf-9d19-be5453bb8814 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063012 Jun 22 20:18:14.238935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1213/2507] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:14 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:15.255353 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8eed3617-ad18-44f5-aeb9-c8de1b7fcf7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19e130d0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:15.311172 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8eed3617-ad18-44f5-aeb9-c8de1b7fcf7f tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.062968 Jun 22 20:18:15.311984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1295/2508] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:15 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:16.332089 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0ef60790-cdaf-4854-9d1a-71c0b59ab8c8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19b7a790>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:16.380452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0ef60790-cdaf-4854-9d1a-71c0b59ab8c8 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.056411 Jun 22 20:18:16.381023 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1214/2509] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:16 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:17.398056 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fd34258f-12b5-44f6-ac48-69edd8cfffe1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19d2d4c0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:17.454207 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fd34258f-12b5-44f6-ac48-69edd8cfffe1 tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.063100 Jun 22 20:18:17.454783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1296/2510] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:17 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:18.472421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-06e9c1b0-d15a-43aa-a6bf-2ef0d8831dbe tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1b157dc0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:18.530334 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-06e9c1b0-d15a-43aa-a6bf-2ef0d8831dbe tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.065886 Jun 22 20:18:18.531050 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1215/2511] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:18 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:19.543605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b65a0196-26e4-471e-8448-5a4157bd263b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc1e471e50>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:19.590952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b65a0196-26e4-471e-8448-5a4157bd263b tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.051808 Jun 22 20:18:19.591558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1297/2512] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:19 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:18:20.604457 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-828778e4-3c7d-433a-aa3c-68b245473eee tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] Calling method '.version_select at 0x7fdc19cd71f0>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:18:20.654648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-828778e4-3c7d-433a-aa3c-68b245473eee tempest-VolumesGetTestJSON-1591880227 tempest-VolumesGetTestJSON-1591880227-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336" status: 200 len: 353 microversion: 2.1 time: 0.054539 Jun 22 20:18:20.655220 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1216/2513] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jun 22 20:18:20 2022] GET /compute/v2.1/os-volumes/956ea3e6-8518-45c7-b689-b413a4add336 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:06.725136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ce804ba8-a107-4c36-98c1-90509c6127e8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'create', calling method: .version_select at 0x7fdc1e463a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-923333783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZtD4FMkEnjh+YfyNYM+DKvRUtYVzPzQjWYtFrnoKrkYSvFv/uSCok59HiskLzSDC8DGn1PV5dU/nZusQfVzuj53oqQ5+RJkluEzox3D71Bz5K78NHPohSMxcbIWhN4cg=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:06.740983 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-ce804ba8-a107-4c36-98c1-90509c6127e8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Getting quotas for project 4718c8d051564f6eb0ddc7600b0354d7. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:19:06.745217 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-ce804ba8-a107-4c36-98c1-90509c6127e8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Getting quotas for user 826c5de24c5d4ab78f1382d86526d04b and project 4718c8d051564f6eb0ddc7600b0354d7. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:19:06.771005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ce804ba8-a107-4c36-98c1-90509c6127e8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050887 Jun 22 20:19:06.771593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1298/2514] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 20:19:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:06.829896 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1938842532", "imageRef": "ac639295-ce62-4116-8300-1816e582ace8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-923333783", "networks": [{"uuid": "b5345c9f-74ab-4d6c-8318-510a117d1267"}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:06.881372 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] validate_networks() for [('b5345c9f-74ab-4d6c-8318-510a117d1267', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:19:07.256499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:19:07.256935 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:19:07.257402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:19:07.257806 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:19:07.258211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:19:07.267866 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:07.268404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:07.269232 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:07.269660 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:07.286921 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Getting quotas for project 4718c8d051564f6eb0ddc7600b0354d7. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:19:07.291282 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Getting quotas for user 826c5de24c5d4ab78f1382d86526d04b and project 4718c8d051564f6eb0ddc7600b0354d7. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:19:07.303558 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:19:07.305786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac639295-ce62-4116-8300-1816e582ace8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:19:07.351082 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ead80fa2-a6db-4464-a52f-f98bb17c2ed2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526388 Jun 22 20:19:07.351696 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1217/2515] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:19:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 20:19:07.361584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-3c6fa53b-3675-48c2-84c3-8df0f531933a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:07.362465 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-3c6fa53b-3675-48c2-84c3-8df0f531933a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:07.417852 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-3c6fa53b-3675-48c2-84c3-8df0f531933a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:07.426817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-3c6fa53b-3675-48c2-84c3-8df0f531933a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1258 microversion: 2.1 time: 0.069150 Jun 22 20:19:07.430818 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1299/2516] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:07 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:19:08.443583 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:08.444346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:08.452132 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:08.452634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:08.454019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:08.454621 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:08.808145 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:08.818195 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b2febf28-9ddf-4d5c-ad33-f9894c1b3d1d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1328 microversion: 2.1 time: 0.378964 Jun 22 20:19:08.826890 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1218/2517] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:08 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:09.835432 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:09.837735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:09.846646 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:09.847751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:09.848667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:09.849219 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:09.997528 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:10.006793 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5f474f77-a80a-41be-b650-dd57f8cab753 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.175330 Jun 22 20:19:10.007390 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1300/2518] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:09 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:10.421026 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:19:10.421665 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:19:11.024217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:11.024947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:11.031947 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:11.032760 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:11.033766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:11.034403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:11.171347 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:11.179780 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fa310008-7abd-4702-8b6c-877be51d488d tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.159994 Jun 22 20:19:11.180750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1219/2519] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:11 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:19:12.199827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:12.200609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:12.208093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:12.208655 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:12.209538 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:12.210034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:12.371471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:12.379085 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-a62b30b1-0486-4803-99e4-86f22f4f717f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.183615 Jun 22 20:19:12.379656 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1301/2520] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:12 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:13.396262 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:13.397666 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:13.405190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:13.405645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:13.406686 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:13.407236 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:13.550266 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:13.559680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f3c82a93-786b-4577-818f-ecaaa494aeb7 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.167115 Jun 22 20:19:13.566288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1220/2521] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:13 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:14.577364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:14.578311 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:14.585939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:14.586397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:14.587553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:14.588175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:14.727147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:14.736039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1ad04d28-e257-4ddc-86b5-6e0e6b6891dc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.162731 Jun 22 20:19:14.736958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1302/2522] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:14 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:15.769032 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:15.774750 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:15.787464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:15.788895 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:15.791001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:15.792171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:15.938136 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:15.945911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7aa9e392-3d21-4cc5-9f9c-40f60365c14f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.192518 Jun 22 20:19:15.946482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1221/2523] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:15 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:16.967312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:16.968346 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:16.979645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:16.980470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:16.981727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:16.982442 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:17.116648 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:17.127407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-639240c3-0938-4452-8a25-6e1f4b4e947c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.166749 Jun 22 20:19:17.128047 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1303/2524] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:16 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:18.150399 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:18.151366 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:18.154942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:18.156205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:18.165728 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:18.166168 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:18.166917 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:18.167343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:18.304182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:18.311768 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8facd358-4396-4a8a-9ea2-96d3ff0f41a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.168145 Jun 22 20:19:18.312402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1222/2525] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:18 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:19.331815 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:19.332491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:19.334297 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:19.341203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:19.341706 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:19.343069 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:19.343784 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:19.819034 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:19.827419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dab9efd4-9831-44c6-9769-fba349b56675 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.502151 Jun 22 20:19:19.828381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1304/2526] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:19 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:20.209595 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-20c17645-1860-4944-82da-727366732fd7 req-a2326d7d-623d-49fb-955d-6eae349c58c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:20.223778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-20c17645-1860-4944-82da-727366732fd7 req-a2326d7d-623d-49fb-955d-6eae349c58c9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:20.224215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-20c17645-1860-4944-82da-727366732fd7 req-a2326d7d-623d-49fb-955d-6eae349c58c9 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:20.237999 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-20c17645-1860-4944-82da-727366732fd7 req-a2326d7d-623d-49fb-955d-6eae349c58c9 service nova] Creating event network-changed:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:19:20.244318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-20c17645-1860-4944-82da-727366732fd7 req-a2326d7d-623d-49fb-955d-6eae349c58c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039581 Jun 22 20:19:20.245958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1223/2527] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:19:20.848689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:20.849591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:20.860639 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:20.861387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:20.862652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:20.863378 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:21.006236 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:21.017470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c4386ab9-9f73-4208-8053-cf37a944e0e9 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.175371 Jun 22 20:19:21.018255 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1305/2528] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:20 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:22.039766 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:22.040855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:22.048151 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:22.048600 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:22.049421 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:22.049881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:22.193084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:22.201280 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fa395845-4b2c-4d4e-a2a1-f711ed88d2c1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.168920 Jun 22 20:19:22.201841 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1224/2529] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:22 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:23.218674 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:23.219285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:23.225956 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:23.226401 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:23.227160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:23.227587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:23.364009 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:23.373670 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c7ce9c38-2729-4f83-98e3-5bed46f405d3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.159360 Jun 22 20:19:23.374476 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1306/2530] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:23 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:24.396279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:24.397239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:24.408333 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:24.409121 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:24.410376 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:24.411085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:24.544738 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:24.555774 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-53e638a1-2f11-4a7b-91a1-fec422e4556c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.165757 Jun 22 20:19:24.556574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1225/2531] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:24 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:24.962981 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-dd398b82-6548-42bf-8530-af5c5d90b973 req-dc3361aa-5068-45f3-a774-e5a4dafff685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "name": "network-vif-plugged", "status": "completed", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:24.972149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-dd398b82-6548-42bf-8530-af5c5d90b973 req-dc3361aa-5068-45f3-a774-e5a4dafff685 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:24.972717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-dd398b82-6548-42bf-8530-af5c5d90b973 req-dc3361aa-5068-45f3-a774-e5a4dafff685 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:24.985291 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-dd398b82-6548-42bf-8530-af5c5d90b973 req-dc3361aa-5068-45f3-a774-e5a4dafff685 service nova] Creating event network-vif-plugged:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:19:24.991602 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-dd398b82-6548-42bf-8530-af5c5d90b973 req-dc3361aa-5068-45f3-a774-e5a4dafff685 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 Jun 22 20:19:24.992645 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1307/2532] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:25.580171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:25.581053 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:25.589902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:25.590344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:25.591086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:25.591507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:25.738043 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:25.749865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5d8a5cd4-f796-4af7-9470-d2228e4ccb24 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.175492 Jun 22 20:19:25.750672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1226/2533] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:25 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:26.775914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:26.777133 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:26.787934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:26.788707 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:26.789958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:26.790591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:26.949998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:26.958226 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9fa1b72b-facc-4732-88e2-a43c95d4fa32 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1358 microversion: 2.1 time: 0.190218 Jun 22 20:19:26.958797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1308/2534] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:26 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:27.979055 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:27.979703 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:27.986633 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:27.987075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:27.987834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:27.988301 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.118743 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:28.126321 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7c2ab720-b02e-43ea-b64c-6bd7a4f608b5 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1548 microversion: 2.1 time: 0.153850 Jun 22 20:19:28.126892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1227/2535] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:27 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:28.142510 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:28.143121 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:28.149842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.150326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.151090 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.151524 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.292552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:28.300441 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d66e9d36-626c-412c-8b93-ea11ab5459c2 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1548 microversion: 2.1 time: 0.161779 Jun 22 20:19:28.301008 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1309/2536] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:28 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:19:28.316239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:28.319710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:28.320507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Searching by: {'deleted': False, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7'} {{(pid=124856) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 20:19:28.328351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.328823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.329598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.330018 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.418016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.multi_cell_list [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124856) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 20:19:28.509788 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f77a63ee-14b1-4f0c-aaa3-7e7d7477894b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197176 Jun 22 20:19:28.510295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1228/2537] 10.222.0.26 () {58 vars in 1124 bytes} [Wed Jun 22 20:19:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:28.523469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:28.524075 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:28.530393 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.530830 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.531580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:28.531998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:28.675958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:28.683712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-adb2a5e0-7f28-43b3-b4d7-655528924a9f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1548 microversion: 2.1 time: 0.164207 Jun 22 20:19:28.684315 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1310/2538] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:28 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 20:19:30.210803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0492c6a6-b4b7-4afe-a86f-353a98299624"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:30.211911 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:30.218613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:30.219059 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:30.219815 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:30.220279 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:30.495958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-2109a5fa-2632-4e52-a5e5-9080f4e2dfef tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288682 Jun 22 20:19:30.496597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1229/2539] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jun 22 20:19:30 2022] POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:38.098293 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:38.098907 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:38.101074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:38.106436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:38.106888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:38.107651 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:38.108080 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:38.111358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=63 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:38.261544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:38.269918 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-351a6e09-7078-453c-8e0c-3c1f5f69227f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1594 microversion: 2.1 time: 0.175645 Jun 22 20:19:38.270495 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1311/2540] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:38 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:39.965094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:39.974844 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-dd4810bf-6c27-4082-85d5-6b58b162f2a5 req-236493b3-6f68-418e-8098-01593eaac142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:39.981624 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:39.990477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-dd4810bf-6c27-4082-85d5-6b58b162f2a5 req-236493b3-6f68-418e-8098-01593eaac142 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:39.990842 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-dd4810bf-6c27-4082-85d5-6b58b162f2a5 req-236493b3-6f68-418e-8098-01593eaac142 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:39.995467 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:19:40.005449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-dd4810bf-6c27-4082-85d5-6b58b162f2a5 req-236493b3-6f68-418e-8098-01593eaac142 service nova] Creating event network-changed:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:19:40.011834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-dd4810bf-6c27-4082-85d5-6b58b162f2a5 req-236493b3-6f68-418e-8098-01593eaac142 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051320 Jun 22 20:19:40.013084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1230/2541] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:19:41.071558 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-113308581"}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:41.072144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:41.078903 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:41.079341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:41.080120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:41.080517 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:41.210622 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.network.security_group_api [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Adding security group 7445dad8-3b3a-4b52-9b71-d6ebe7df67a8 to port 1b265234-f8aa-4542-b979-7ebf42d0cf26 Jun 22 20:19:41.577028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-83f4f397-a8c7-44f0-bb98-55a24b802507 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action" status: 202 len: 0 microversion: 2.1 time: 0.509318 Jun 22 20:19:41.578354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1312/2542] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 20:19:41 2022] POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 20:19:41.589171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:19:41.590422 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:19:41.600835 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:41.602662 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:41.603892 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:41.604073 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:41.763603 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:19:41.772016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6825a3f0-1bcf-45cd-8c90-7c4ffe4c20dd tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1758 microversion: 2.1 time: 0.188172 Jun 22 20:19:41.776300 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1231/2543] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:19:41 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:19:42.152888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-72aded7f-10bf-4f39-bcf7-4cf714d68ebf req-a8a2dc4d-61bb-4750-8836-8676e0220a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:19:42.161175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-72aded7f-10bf-4f39-bcf7-4cf714d68ebf req-a8a2dc4d-61bb-4750-8836-8676e0220a81 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:19:42.161608 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-72aded7f-10bf-4f39-bcf7-4cf714d68ebf req-a8a2dc4d-61bb-4750-8836-8676e0220a81 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:19:42.173152 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-72aded7f-10bf-4f39-bcf7-4cf714d68ebf req-a8a2dc4d-61bb-4750-8836-8676e0220a81 service nova] Creating event network-changed:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:19:42.178153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-72aded7f-10bf-4f39-bcf7-4cf714d68ebf req-a8a2dc4d-61bb-4750-8836-8676e0220a81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154067 Jun 22 20:19:42.178912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1313/2544] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:20:26.860848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:20:26.861720 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:20:36.020312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:20:36.021246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:20:42.239149 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:20:42.240371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=7 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:20:42.247400 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:20:42.249088 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:42.260497 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:42.261246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:42.262613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:42.263049 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:42.339156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b6a021b3-410d-4943-84ed-457b098053a4 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action" status: 202 len: 0 microversion: 2.1 time: 0.102855 Jun 22 20:20:42.342418 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1232/2545] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 20:20:42 2022] POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:20:42.346462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=5 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:20:42.347303 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=11 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:20:42.351868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:42.352587 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:42.360141 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:42.360601 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:42.361355 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:42.361787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:42.658934 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:42.667242 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-1967231e-2e2f-4874-b20d-5d24b40fed01 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1750 microversion: 2.1 time: 0.322783 Jun 22 20:20:42.667808 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1314/2546] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:42 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1750 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:43.690853 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:43.692002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:43.701670 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:43.702482 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:43.703246 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:43.703674 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:43.907492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:43.915786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7c363577-ad5d-4fb6-a9ad-8a4ffa852bb1 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.233021 Jun 22 20:20:43.916360 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1233/2547] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:43 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:44.935922 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:44.936502 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:44.943376 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:44.943827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:44.944627 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:44.945060 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:45.100715 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:45.109153 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9feecbb1-fca9-4aa5-8dde-b87ed9629289 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.179075 Jun 22 20:20:45.109723 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1315/2548] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:44 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:46.130663 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:46.131638 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:46.140784 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:46.141229 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:46.141975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:46.142396 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:46.297075 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:46.308742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5dedde1c-6253-4e4f-9d65-f898fc23907f tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.184530 Jun 22 20:20:46.309338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1234/2549] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:46 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:47.331273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:47.332302 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:47.342811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:47.343265 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:47.344030 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:47.344508 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:47.496549 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:47.504756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5b79429f-6ef6-494a-96e1-6f474a8350b3 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.180461 Jun 22 20:20:47.505742 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1316/2550] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:47 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:48.527058 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:48.528065 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:48.535604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:48.536061 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:48.536874 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:48.537316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:48.688392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:48.697077 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-ea633da6-2f30-42b3-843b-4fbfdb815de8 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.176556 Jun 22 20:20:48.697648 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1235/2551] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:48 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:49.718858 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:49.719801 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:49.730945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:49.731682 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:49.732757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:49.733185 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:49.888797 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:49.897409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-b1bdc814-4c07-416a-a766-0dc37d77eb55 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.185282 Jun 22 20:20:49.897979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1317/2552] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:49 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:50.918691 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:50.919537 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:50.930692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:50.931437 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:50.932798 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:50.933519 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:51.084742 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:51.093545 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-23720738-eae1-41fb-b3d0-5e0231a0bbdc tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.181390 Jun 22 20:20:51.093973 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1236/2553] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:50 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:52.115705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:52.116740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:52.127201 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:52.127958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:52.129155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:52.129853 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:52.293820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:52.302419 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-318c1715-f227-4f52-ba0d-87b575c91f65 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.194040 Jun 22 20:20:52.302982 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1318/2554] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:52 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:53.322764 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:53.323754 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:53.332472 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:53.332922 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:53.333675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:53.334097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:53.491739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:53.500346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-784189fb-f28a-495e-9d68-05132b3e0008 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1755 microversion: 2.1 time: 0.184057 Jun 22 20:20:53.500920 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1237/2555] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:53 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:20:54.526323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:20:54.527341 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:20:54.538652 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:54.539399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:54.540727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:20:54.541451 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:20:54.696764 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:20:54.707039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-91d6641f-6ce4-4a50-84a9-c05eab8b0a0b tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1758 microversion: 2.1 time: 0.187352 Jun 22 20:20:54.707591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1319/2556] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:20:54 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:21:57.865276 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=12 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:21:57.866496 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:21:57.873355 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-113308581"}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:21:57.874217 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:21:57.885251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:57.885729 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:57.886480 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:57.886899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:58.029994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.network.security_group_api [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Removing security group 7445dad8-3b3a-4b52-9b71-d6ebe7df67a8 from port 1b265234-f8aa-4542-b979-7ebf42d0cf26 Jun 22 20:21:58.370625 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-12235aaa-fc5d-4e04-8646-f8d4ffc5b70a tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action" status: 202 len: 0 microversion: 2.1 time: 0.508559 Jun 22 20:21:58.371725 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1238/2557] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jun 22 20:21:57 2022] POST /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:21:58.378349 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=12 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:21:58.379722 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=36 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:21:58.450641 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-3edff3c6-e785-4fea-93de-1fca575caa4c req-778d3d6a-da9c-476e-8690-6e3e17358e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:21:58.460436 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-3edff3c6-e785-4fea-93de-1fca575caa4c req-778d3d6a-da9c-476e-8690-6e3e17358e12 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:58.461203 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-3edff3c6-e785-4fea-93de-1fca575caa4c req-778d3d6a-da9c-476e-8690-6e3e17358e12 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:58.477891 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-3edff3c6-e785-4fea-93de-1fca575caa4c req-778d3d6a-da9c-476e-8690-6e3e17358e12 service nova] Creating event network-changed:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:21:58.484028 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-3edff3c6-e785-4fea-93de-1fca575caa4c req-778d3d6a-da9c-476e-8690-6e3e17358e12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107424 Jun 22 20:21:58.485453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1320/2558] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:21:59.778094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:21:59.778596 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:21:59.779879 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-c6135b0c-a666-425f-bed9-b8f259771ccc req-624d2860-f7b9-47a4-b91c-240797f44b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:21:59.784869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:59.785314 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:59.786313 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:59.786826 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:59.789529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c6135b0c-a666-425f-bed9-b8f259771ccc req-624d2860-f7b9-47a4-b91c-240797f44b2c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:59.790190 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-c6135b0c-a666-425f-bed9-b8f259771ccc req-624d2860-f7b9-47a4-b91c-240797f44b2c service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:59.801892 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-c6135b0c-a666-425f-bed9-b8f259771ccc req-624d2860-f7b9-47a4-b91c-240797f44b2c service nova] Creating event network-changed:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:21:59.807445 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-c6135b0c-a666-425f-bed9-b8f259771ccc req-624d2860-f7b9-47a4-b91c-240797f44b2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031618 Jun 22 20:21:59.808700 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1321/2559] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:21:59.873141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.objects.instance [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lazy-loading 'services' on Instance uuid bf94c8b9-13a8-4216-981f-cca88a2c89c7 {{(pid=124856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:21:59.951757 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-374627ce-0f4c-43d5-b565-294c94cc1c9c tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments/0492c6a6-b4b7-4afe-a86f-353a98299624" status: 202 len: 0 microversion: 2.1 time: 0.177741 Jun 22 20:21:59.952564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1239/2560] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:21:59 2022] DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments/0492c6a6-b4b7-4afe-a86f-353a98299624 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:21:59.962897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:21:59.964347 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:21:59.972381 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:59.972831 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:21:59.973842 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:21:59.974337 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:00.016867 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-9e5f6b85-0197-4b51-91a9-19701af26eba tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058235 Jun 22 20:22:00.017877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1322/2561] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:21:59 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:22:01.033786 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:01.034992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:01.044090 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:01.044778 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:01.045843 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:01.046490 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:01.080668 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-eaa9da85-836d-44cd-ae1d-2f1da1bd4798 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054363 Jun 22 20:22:01.081208 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1240/2562] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jun 22 20:22:01 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 20:22:01.091364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:01.091846 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:01.098931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:01.099384 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:01.100192 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:01.100657 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:01.183128 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] HTTP exception thrown: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 is not attached to volume 0492c6a6-b4b7-4afe-a86f-353a98299624 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Request method failure captured: Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments/0492c6a6-b4b7-4afe-a86f-353a98299624 HTTP/1.1 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3ksZLQassgpZ9BhEgAl9jhCHchJSc8s1B-0p7ld52XffUiumst2sZIcjE7iAkNsWDh5nHoZ9e4csYVg2srVMFSIyGF5H2RNJRyInsUgyQ_iZBihNxQbSzm5xKPw6ocPEgO1Z_9vxt-hq4_nu45m52vVuTmk_N9X2j2DEkK0jMC08RA Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 4718c8d051564f6eb0ddc7600b0354d7 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:22:01.185124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4718c8d051564f6eb0ddc7600b0354d7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 4718c8d051564f6eb0ddc7600b0354d7 Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-TestMinimumBasicScenario-1846635444-project Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 826c5de24c5d4ab78f1382d86526d04b Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-TestMinimumBasicScenario-1846635444-project Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:22:01.186474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 is not attached to volume 0492c6a6-b4b7-4afe-a86f-353a98299624 Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'server_id': 'bf94c8b9-13a8-4216-981f-cca88a2c89c7', 'id': '0492c6a6-b4b7-4afe-a86f-353a98299624'} Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0492c6a6-b4b7-4afe-a86f-353a98299624. Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:22:01.187170 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 is not attached to volume 0492c6a6-b4b7-4afe-a86f-353a98299624 Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 is not attached to volume 0492c6a6-b4b7-4afe-a86f-353a98299624 Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:01.188735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Returning 404 to user: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 is not attached to volume 0492c6a6-b4b7-4afe-a86f-353a98299624 {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:22:01.189938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2287cfcd-04d0-4ddd-94d2-a0a943d8d089 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments/0492c6a6-b4b7-4afe-a86f-353a98299624" status: 404 len: 154 microversion: 2.1 time: 0.099202 Jun 22 20:22:01.189938 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1323/2563] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jun 22 20:22:01 2022] DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7/os-volume_attachments/0492c6a6-b4b7-4afe-a86f-353a98299624 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:22:02.345198 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:02.345675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:02.355619 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:02.356247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:02.357378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:02.357958 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:02.385960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:22:02.472867 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5ccd6408-c93a-4eb7-a79f-b958a5e50392 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 204 len: 0 microversion: 2.1 time: 0.133375 Jun 22 20:22:02.473465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1241/2564] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:22:02 2022] DELETE /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:22:02.482933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:02.483585 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:02.490360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:02.490814 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:02.491579 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:02.492004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:02.642377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:02.655007 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fb6f2436-4361-44db-accf-bcc9e0eca8cb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1554 microversion: 2.1 time: 0.175607 Jun 22 20:22:02.655877 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1324/2565] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:02 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:03.676893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:03.677594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:03.684644 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:03.685097 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:03.685863 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:03.686296 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:03.821251 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:03.833404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-66c0777a-b310-43d0-be43-108a988e7395 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1554 microversion: 2.1 time: 0.160674 Jun 22 20:22:03.834206 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1242/2566] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:03 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:04.447591 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:22:04.448547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:22:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:22:04.851463 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:04.852130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:04.860721 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:04.861174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:04.861963 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:04.862398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:05.249576 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826c5de24c5d4ab78f1382d86526d04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4718c8d051564f6eb0ddc7600b0354d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:05.260296 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-041c1f52-01bf-424c-a433-51052f32aeeb tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 200 len: 1554 microversion: 2.1 time: 0.412676 Jun 22 20:22:05.261011 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1325/2567] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:04 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:05.301785 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-ff564e00-ce7f-4a1a-b0ef-ac6523d20da5 req-d03512e6-970f-45fe-84d2-00c913f92934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf94c8b9-13a8-4216-981f-cca88a2c89c7", "name": "network-vif-deleted", "tag": "1b265234-f8aa-4542-b979-7ebf42d0cf26"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:22:05.310450 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ff564e00-ce7f-4a1a-b0ef-ac6523d20da5 req-d03512e6-970f-45fe-84d2-00c913f92934 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:05.310888 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ff564e00-ce7f-4a1a-b0ef-ac6523d20da5 req-d03512e6-970f-45fe-84d2-00c913f92934 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:05.321939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-ff564e00-ce7f-4a1a-b0ef-ac6523d20da5 req-d03512e6-970f-45fe-84d2-00c913f92934 service nova] Creating event network-vif-deleted:1b265234-f8aa-4542-b979-7ebf42d0cf26 for instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 on hv-cinder-84721 Jun 22 20:22:05.327710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-ff564e00-ce7f-4a1a-b0ef-ac6523d20da5 req-d03512e6-970f-45fe-84d2-00c913f92934 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029323 Jun 22 20:22:05.328329 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1243/2568] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:22:06.280955 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:06.281752 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] [instance: bf94c8b9-13a8-4216-981f-cca88a2c89c7] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:06.290147 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:06.290724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:06.291637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:06.292187 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:06.308782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] HTTP exception thrown: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Request method failure captured: Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 HTTP/1.1 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3ksZLQassgpZ9BhEgAl9jhCHchJSc8s1B-0p7ld52XffUiumst2sZIcjE7iAkNsWDh5nHoZ9e4csYVg2srVMFSIyGF5H2RNJRyInsUgyQ_iZBihNxQbSzm5xKPw6ocPEgO1Z_9vxt-hq4_nu45m52vVuTmk_N9X2j2DEkK0jMC08RA Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 4718c8d051564f6eb0ddc7600b0354d7 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:22:06.310618 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4718c8d051564f6eb0ddc7600b0354d7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4718c8d051564f6eb0ddc7600b0354d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 4718c8d051564f6eb0ddc7600b0354d7 Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1846635444 Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-TestMinimumBasicScenario-1846635444-project Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 826c5de24c5d4ab78f1382d86526d04b Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-TestMinimumBasicScenario-1846635444-project Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. Jun 22 20:22:06.311824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': 'bf94c8b9-13a8-4216-981f-cca88a2c89c7'} Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:22:06.312551 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. Jun 22 20:22:06.313605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:22:06.314767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Returning 404 to user: Instance bf94c8b9-13a8-4216-981f-cca88a2c89c7 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:22:06.314767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ee880a89-b350-491e-b6fc-a0e1af88f405 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7" status: 404 len: 111 microversion: 2.1 time: 0.037305 Jun 22 20:22:06.314767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1326/2569] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:06 2022] GET /compute/v2.1/servers/bf94c8b9-13a8-4216-981f-cca88a2c89c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:22:06.321941 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-e4c2d4ff-693b-42e4-9830-09d86dc8b950 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] Calling method '.version_select at 0x7fdc19cd7550>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:06.347548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-e4c2d4ff-693b-42e4-9830-09d86dc8b950 tempest-TestMinimumBasicScenario-1846635444 tempest-TestMinimumBasicScenario-1846635444-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-923333783" status: 202 len: 0 microversion: 2.1 time: 0.030251 Jun 22 20:22:06.348140 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1244/2570] 10.222.0.26 () {58 vars in 1268 bytes} [Wed Jun 22 20:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-923333783 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:22:14.815256 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:22:14.815902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:22:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:22:23.734998 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=14 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:23.735887 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=30 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:23.920839 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-93eb4bfe-75bd-448e-aff7-890fc43425f6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Action: 'create', calling method: .version_select at 0x7fdc19d6ae50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-241802469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJblOixhkNQAtQONm1Lj0/xxvPFHhu0Gqij0f8/vEZAhGbnHutAIm0TRPhe8n2g6xRi/ivStaSeufHuRBrq+0867QvyCBP4dRihRhUeNqzRCQ+AaqPBt6XVLXYgNXe4QlA=="}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:22:23.935184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-93eb4bfe-75bd-448e-aff7-890fc43425f6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:22:23.939278 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-93eb4bfe-75bd-448e-aff7-890fc43425f6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for user 6cd234ffa7214a23b14873c415dda768 and project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'key_pairs'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:22:23.968004 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-93eb4bfe-75bd-448e-aff7-890fc43425f6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.238281 Jun 22 20:22:23.968663 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1327/2571] 10.222.0.26 () {60 vars in 1158 bytes} [Wed Jun 22 20:22:23 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:22:45.575411 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:45.576268 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:45.580871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2005168730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241802469", "security_groups": [{"name": "tempest-secgroup-smoke-639828283"}], "block_device_mapping_v2": [{"uuid": "7d8b231f-7dc0-407b-8ea7-b60cf4074405", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d685ce8-70a7-436c-a39c-5459d163cb0e"}]}} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:22:45.701293 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.network.neutron [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] validate_networks() for [('3d685ce8-70a7-436c-a39c-5459d163cb0e', None, None, None, None, None)] {{(pid=124856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:22:46.182416 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:22:46.182836 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image limits 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:22:46.183306 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:22:46.183712 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image pref 0:0:0 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:22:46.184126 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.virt.hardware [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:22:46.193707 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:46.194157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:46.194942 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:46.195370 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:46.212792 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:22:46.217222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.quota [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for user 6cd234ffa7214a23b14873c415dda768 and project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:22:46.273557 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Going to run 1 instances... {{(pid=124856) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:22:46.275752 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d8b231f-7dc0-407b-8ea7-b60cf4074405',volume_size=None,volume_type=None)] {{(pid=124856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:22:46.411871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-151f7cac-281d-484d-a110-2b526aa4687c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.837887 Jun 22 20:22:46.412586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1245/2572] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:22:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 20:22:46.422741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2d2051f7-b2ab-4161-9a9b-80726bf2d2b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:46.423329 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2d2051f7-b2ab-4161-9a9b-80726bf2d2b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:46.425542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=4 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:46.426373 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:46.486824 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-2d2051f7-b2ab-4161-9a9b-80726bf2d2b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:46.494541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2d2051f7-b2ab-4161-9a9b-80726bf2d2b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1094 microversion: 2.1 time: 0.075897 Jun 22 20:22:46.495350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1328/2573] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:46 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:47.511997 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:47.512672 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:47.519332 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:47.519775 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:47.520645 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:47.521067 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:47.586395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:47.595144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f97a61e3-51b9-4ad3-b0ca-642005126257 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1200 microversion: 2.1 time: 0.087669 Jun 22 20:22:47.607200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1246/2574] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:47 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:48.614609 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:48.615194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:48.622971 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:48.623427 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:48.624230 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:48.624661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:48.855984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:48.865049 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-951d55fd-6c89-459c-9bb7-d08284b42f01 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.254018 Jun 22 20:22:48.876018 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1329/2575] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:48 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:49.087403 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-d3041226-54c3-41fa-af6f-604cca364761 req-a2aeb4ff-f1e5-4221-8705-fa9ad1d7e7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082c0f64-fab7-4c59-9372-8891697212d0", "tag": "8a16ebea-75bf-43bd-a938-c2fcaf7c36c4"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:22:49.096348 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-d3041226-54c3-41fa-af6f-604cca364761 req-a2aeb4ff-f1e5-4221-8705-fa9ad1d7e7c2 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:49.096834 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-d3041226-54c3-41fa-af6f-604cca364761 req-a2aeb4ff-f1e5-4221-8705-fa9ad1d7e7c2 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:49.115869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-d3041226-54c3-41fa-af6f-604cca364761 req-a2aeb4ff-f1e5-4221-8705-fa9ad1d7e7c2 service nova] Creating event network-changed:8a16ebea-75bf-43bd-a938-c2fcaf7c36c4 for instance 082c0f64-fab7-4c59-9372-8891697212d0 on hv-cinder-84721 Jun 22 20:22:49.121177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-d3041226-54c3-41fa-af6f-604cca364761 req-a2aeb4ff-f1e5-4221-8705-fa9ad1d7e7c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037471 Jun 22 20:22:49.121981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1247/2576] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:22:49.886675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:49.887415 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:49.895513 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:49.896029 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:49.896962 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:49.897471 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:50.052388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:50.060003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-672adf61-cb11-4b4d-9d53-e2e010e001b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.179492 Jun 22 20:22:50.060590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1330/2577] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:49 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:51.083420 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:51.084498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:51.092870 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:51.093318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:51.094086 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:51.094517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:51.224943 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:51.233389 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fef40570-f25e-412a-819a-8d1a08025429 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.158344 Jun 22 20:22:51.233961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1248/2578] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:51 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:52.254515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:52.255504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:52.264472 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:52.264929 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:52.265694 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:52.266131 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:52.401268 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:52.409158 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-406a58f1-5e4e-4ce9-a76a-33b270b5c1ed tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.161298 Jun 22 20:22:52.409724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1331/2579] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:52 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:53.429998 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:53.430994 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:53.439155 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:53.439650 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:53.440534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:53.441008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:53.580857 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:53.591709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fd6c2705-03ab-492e-8075-b484ab157198 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.168020 Jun 22 20:22:53.592597 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1249/2580] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:53 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:54.617161 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:54.618168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:54.627343 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:54.627925 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:54.629026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:54.629611 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:54.770163 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:54.778062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb70d28a-7310-40a6-87ce-f6d863b3437c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.167448 Jun 22 20:22:54.778630 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1332/2581] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:54 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:55.799171 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:55.800041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:55.810939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:55.811684 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:55.812992 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:55.813709 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:55.946899 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:55.955182 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-00dd4e63-5ba5-462f-ac45-789e610f2711 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.162655 Jun 22 20:22:55.955745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1250/2582] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:55 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:56.975345 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:56.976391 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:56.980088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:56.989490 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:56.990246 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:56.991562 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:56.992309 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:57.148923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:57.158211 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6e3ba77a-04ad-4190-971b-79d1ee290637 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.189323 Jun 22 20:22:57.158775 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1333/2583] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:56 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:58.179367 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:58.180278 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:58.183284 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:58.184452 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=6 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:22:58.195667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:58.196458 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:58.197706 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:58.198509 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:58.337037 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:58.344907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-167dda68-950e-47f2-ac0b-bcfd2de0a0b7 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.172168 Jun 22 20:22:58.345735 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1251/2584] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:58 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:59.364507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:22:59.365332 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:22:59.373729 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:59.374173 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:59.374933 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:59.375365 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:59.518021 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:22:59.526151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-dfd2aae7-d19f-4fc0-82cc-362a130fb669 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.167103 Jun 22 20:22:59.526727 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1334/2585] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:22:59 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:22:59.914157 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-c3785ddc-c089-4675-80ee-8ca0000d73e7 req-1ccd6ccd-c375-4c00-8fac-92117b8d1356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082c0f64-fab7-4c59-9372-8891697212d0", "name": "network-vif-plugged", "status": "completed", "tag": "8a16ebea-75bf-43bd-a938-c2fcaf7c36c4"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:22:59.922375 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c3785ddc-c089-4675-80ee-8ca0000d73e7 req-1ccd6ccd-c375-4c00-8fac-92117b8d1356 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:22:59.922811 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-c3785ddc-c089-4675-80ee-8ca0000d73e7 req-1ccd6ccd-c375-4c00-8fac-92117b8d1356 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:22:59.933980 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-c3785ddc-c089-4675-80ee-8ca0000d73e7 req-1ccd6ccd-c375-4c00-8fac-92117b8d1356 service nova] Creating event network-vif-plugged:8a16ebea-75bf-43bd-a938-c2fcaf7c36c4 for instance 082c0f64-fab7-4c59-9372-8891697212d0 on hv-cinder-84721 Jun 22 20:22:59.938975 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-c3785ddc-c089-4675-80ee-8ca0000d73e7 req-1ccd6ccd-c375-4c00-8fac-92117b8d1356 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089028 Jun 22 20:22:59.939540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1252/2586] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:23:00.546635 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:23:00.547540 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:23:00.558569 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:00.559312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:00.560796 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:00.561511 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:00.707132 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:23:00.714866 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-22a55694-546f-48b4-97d8-da85a8ee52e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.175074 Jun 22 20:23:00.715786 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1335/2587] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:23:00 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:23:01.737100 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:23:01.738056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:23:01.745677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:01.746207 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:01.747111 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:01.748225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:01.888594 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:23:01.896325 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-b273eeeb-b616-45bb-b794-16e8afae85cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1265 microversion: 2.1 time: 0.166093 Jun 22 20:23:01.896894 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1253/2588] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:23:01 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:23:02.917590 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:23:02.918452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:23:02.929785 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:02.930533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:02.931791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:02.932575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:03.080134 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:23:03.089458 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-48bbf7ce-b5de-4763-98d8-c6306b4c4f19 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1453 microversion: 2.1 time: 0.178593 Jun 22 20:23:03.090039 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1336/2589] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:23:02 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:23:03.105613 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:23:03.106218 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:23:03.113395 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:03.113845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:03.114604 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:03.115031 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:03.257462 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:23:03.265343 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9d555a66-d0a5-4dc9-b061-393ad4786a4b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1453 microversion: 2.1 time: 0.163617 Jun 22 20:23:03.265916 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1254/2590] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:23:03 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:23:05.179979 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-30694941-515a-4953-9ffd-a4f9795b90c5 req-994e8272-116a-4276-8dba-283f52e37562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082c0f64-fab7-4c59-9372-8891697212d0", "tag": "8a16ebea-75bf-43bd-a938-c2fcaf7c36c4"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:23:05.188693 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-30694941-515a-4953-9ffd-a4f9795b90c5 req-994e8272-116a-4276-8dba-283f52e37562 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:23:05.189149 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-30694941-515a-4953-9ffd-a4f9795b90c5 req-994e8272-116a-4276-8dba-283f52e37562 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:23:05.200397 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-30694941-515a-4953-9ffd-a4f9795b90c5 req-994e8272-116a-4276-8dba-283f52e37562 service nova] Creating event network-changed:8a16ebea-75bf-43bd-a938-c2fcaf7c36c4 for instance 082c0f64-fab7-4c59-9372-8891697212d0 on hv-cinder-84721 Jun 22 20:23:05.205817 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-30694941-515a-4953-9ffd-a4f9795b90c5 req-994e8272-116a-4276-8dba-283f52e37562 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029603 Jun 22 20:23:05.206704 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1337/2591] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:23:56.032876 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:23:56.034010 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:25:19.373717 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 20:25:19.375081 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:19.376342 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=48 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:19.383852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:19.384872 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:19.393622 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:19.394190 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:19.395150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:19.395643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:19.420845 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Going to try to terminate instance {{(pid=124856) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:25:19.485807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [04fd4d72-b4a6-4f49-a9e0-f1762c72b418] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 20:25:20.387255 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40662. Jun 22 20:25:20.498153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [04fd4d72-b4a6-4f49-a9e0-f1762c72b418] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40664. Jun 22 20:25:20.521525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1733aa80-20ee-4137-8902-573010d094b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "DELETE /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 204 len: 0 microversion: 2.1 time: 1.151240 Jun 22 20:25:20.522445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1255/2592] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:25:19 2022] DELETE /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 0 bytes in 1153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:25:20.528945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e325dc84-00e9-48e3-9371-43c824e24431] AMQP server on 10.222.0.26:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jun 22 20:25:20.529580 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=22 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:20.530316 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=50 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:20.535457 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:20.536184 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:20.543144 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:20.543617 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:20.544475 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:20.544927 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:20.686689 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:20.694366 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-8c5ca54e-f64a-429c-abbb-2447d042ffa6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1578 microversion: 2.1 time: 0.167573 Jun 22 20:25:20.694931 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1338/2593] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:20 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:21.715305 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:21.716288 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:21.725960 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:21.726335 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:21.727102 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:21.727523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:21.873338 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:21.881242 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0978669b-78d2-40c8-bc98-be1272d9d065 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1578 microversion: 2.1 time: 0.172179 Jun 22 20:25:21.881803 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1256/2594] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:21 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:22.897889 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:22.898595 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:22.912016 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] [e325dc84-00e9-48e3-9371-43c824e24431] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40676. Jun 22 20:25:22.914086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:22.914507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:22.915289 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:22.916279 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:23.008909 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:23.017015 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fdf86594-f6ac-458d-b383-73e12c7de24b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1511 microversion: 2.1 time: 0.123038 Jun 22 20:25:23.017605 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1339/2595] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:22 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1511 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:23.358944 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-669d89be-4007-4572-aa36-e45f00d5bcf6 req-565caf5e-0b00-4498-960d-c49ae0babe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082c0f64-fab7-4c59-9372-8891697212d0", "name": "network-vif-deleted", "tag": "8a16ebea-75bf-43bd-a938-c2fcaf7c36c4"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:25:23.367292 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-669d89be-4007-4572-aa36-e45f00d5bcf6 req-565caf5e-0b00-4498-960d-c49ae0babe42 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:23.367739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-669d89be-4007-4572-aa36-e45f00d5bcf6 req-565caf5e-0b00-4498-960d-c49ae0babe42 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:23.379445 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-669d89be-4007-4572-aa36-e45f00d5bcf6 req-565caf5e-0b00-4498-960d-c49ae0babe42 service nova] Creating event network-vif-deleted:8a16ebea-75bf-43bd-a938-c2fcaf7c36c4 for instance 082c0f64-fab7-4c59-9372-8891697212d0 on hv-cinder-84721 Jun 22 20:25:23.384833 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-669d89be-4007-4572-aa36-e45f00d5bcf6 req-565caf5e-0b00-4498-960d-c49ae0babe42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156828 Jun 22 20:25:23.385759 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1257/2596] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:25:24.033916 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:24.034486 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:24.042330 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:24.042772 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:24.043552 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:24.043996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:24.077025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:24.077474 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:24.077924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.objects.instance [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lazy-loading 'fault' on Instance uuid 082c0f64-fab7-4c59-9372-8891697212d0 {{(pid=124857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 20:25:24.120871 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:24.128782 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-4325c3e7-78fc-4124-a5d6-56f228450bd8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 200 len: 1230 microversion: 2.1 time: 0.098886 Jun 22 20:25:24.129413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1340/2597] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:24 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:24.461542 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:25:24.461899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:25:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:25:25.151534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:25.152584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:25.163250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:25.163985 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:25.165257 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:25.166005 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:25.181573 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] HTTP exception thrown: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Request method failure captured: Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 HTTP/1.1 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3n6YVPyOHZ2B5YdjTZiKMZ2MpX6K1n21b9YAz5NQpdBAn3UDQYlAH7H68xYVauMj8PMGKaeorZ6xdBXOmFPoVcdGd1jRlRBpQDO_6aVYVqA2YoVixOtN1qJbl5QYzhAJXQMjCYvq8T4CF6VxTW8cyvFtwujElV-AA5TdPLXEgTdprA Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:25:25.183150 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4939f5c261f4408fafc414bf7bdb6f09", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 6cd234ffa7214a23b14873c415dda768 Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:25:25.184466 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '082c0f64-fab7-4c59-9372-8891697212d0'} Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:25:25.185283 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:25:25.186525 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:25:25.187620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Returning 404 to user: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:25:25.187620 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-8cf63c9d-a98f-4a69-8fe7-3b2b07f76813 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 404 len: 111 microversion: 2.1 time: 0.041001 Jun 22 20:25:25.188025 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1258/2598] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:25 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:25:25.235735 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2076608111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241802469", "security_groups": [{"name": "tempest-secgroup-smoke-639828283"}], "block_device_mapping_v2": [{"uuid": "7d8b231f-7dc0-407b-8ea7-b60cf4074405", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d685ce8-70a7-436c-a39c-5459d163cb0e"}]}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:25:25.363820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] validate_networks() for [('3d685ce8-70a7-436c-a39c-5459d163cb0e', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:25:25.809751 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:25:25.810387 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:25:25.811041 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:25:25.811638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:25:25.812194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:25:25.826360 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:25.826952 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:25.828088 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:25.828553 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:25.845878 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:25:25.850124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for user 6cd234ffa7214a23b14873c415dda768 and project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:25:25.908827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:25:25.910910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d8b231f-7dc0-407b-8ea7-b60cf4074405',volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:25:26.043005 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-7cf66039-2031-47a1-b398-3fd8433e5ff8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811244 Jun 22 20:25:26.043600 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1341/2599] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:25:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 20:25:26.055154 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-6f929121-98e5-47ab-b1b4-e39f86fbd0cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:26.055761 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-6f929121-98e5-47ab-b1b4-e39f86fbd0cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:26.110767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-6f929121-98e5-47ab-b1b4-e39f86fbd0cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:26.117652 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-6f929121-98e5-47ab-b1b4-e39f86fbd0cd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1094 microversion: 2.1 time: 0.067336 Jun 22 20:25:26.118222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1259/2600] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:26 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:27.136788 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0660de31-5e27-4ab4-ab6b-d59b8743d962 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:27.137724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0660de31-5e27-4ab4-ab6b-d59b8743d962 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:27.197118 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0660de31-5e27-4ab4-ab6b-d59b8743d962 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:27.204084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0660de31-5e27-4ab4-ab6b-d59b8743d962 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1094 microversion: 2.1 time: 0.073222 Jun 22 20:25:27.204685 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1342/2601] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:27 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:28.220981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-4df67961-da09-4189-8680-94d787b64070 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:28.221590 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-4df67961-da09-4189-8680-94d787b64070 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:28.276577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-4df67961-da09-4189-8680-94d787b64070 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:28.286071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-4df67961-da09-4189-8680-94d787b64070 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1094 microversion: 2.1 time: 0.068762 Jun 22 20:25:28.286700 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1260/2602] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:28 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:29.308946 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c63fe826-731f-42e2-aee1-7cf01ca82d88 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:29.310679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c63fe826-731f-42e2-aee1-7cf01ca82d88 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:29.365168 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c63fe826-731f-42e2-aee1-7cf01ca82d88 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:29.372260 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c63fe826-731f-42e2-aee1-7cf01ca82d88 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1094 microversion: 2.1 time: 0.070023 Jun 22 20:25:29.372829 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1343/2603] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:29 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:30.392749 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:30.393402 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:30.402591 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:30.403192 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:30.404164 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:30.404741 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:30.476165 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:30.484317 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-636f61bd-44d2-413b-ba8c-eb796854f0d1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1144 microversion: 2.1 time: 0.097734 Jun 22 20:25:30.484939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1261/2604] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:30 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:31.501388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:31.502052 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:31.508914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:31.509374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:31.510151 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:31.510584 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:31.591398 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:31.599093 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-fea28a7b-3d6c-417d-92c2-9f89f2757e87 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1210 microversion: 2.1 time: 0.101754 Jun 22 20:25:31.599665 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1344/2605] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:31 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:32.534200 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-bc510f6c-4ab5-4d75-b286-d6bdbcbf9b63 req-ef0ba485-5a27-4261-b12c-6b7993370b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debf9904-1e3f-454f-9f15-7b54a5f22ed0", "tag": "c7dcd8c1-5226-4a25-97ef-d1fd62cc4854"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:25:32.544326 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-bc510f6c-4ab5-4d75-b286-d6bdbcbf9b63 req-ef0ba485-5a27-4261-b12c-6b7993370b9d service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:32.545084 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-bc510f6c-4ab5-4d75-b286-d6bdbcbf9b63 req-ef0ba485-5a27-4261-b12c-6b7993370b9d service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:32.559021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-bc510f6c-4ab5-4d75-b286-d6bdbcbf9b63 req-ef0ba485-5a27-4261-b12c-6b7993370b9d service nova] Creating event network-changed:c7dcd8c1-5226-4a25-97ef-d1fd62cc4854 for instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 on hv-cinder-84721 Jun 22 20:25:32.564373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-bc510f6c-4ab5-4d75-b286-d6bdbcbf9b63 req-ef0ba485-5a27-4261-b12c-6b7993370b9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036764 Jun 22 20:25:32.566179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1262/2606] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:25:32.616257 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:32.616868 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:32.623851 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:32.624659 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:32.625654 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:32.626245 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:32.847910 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:32.856198 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-cda985f9-71c1-43a0-b577-26c1e319375f tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.243857 Jun 22 20:25:32.856780 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1345/2607] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:32 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:33.873881 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:33.874581 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:33.881692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:33.882139 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:33.882912 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:33.883339 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:34.015963 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:34.023639 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-f4a1d07a-ff73-403f-8bc0-fedfeace2de8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.154056 Jun 22 20:25:34.024223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1263/2608] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:33 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:34.826533 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:25:34.826678 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:25:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:25:35.044518 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:35.045504 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:35.056547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:35.057285 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:35.058531 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:35.059232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:35.198575 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:35.206521 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5658642f-2da8-4f67-9392-1c645f99478a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.168503 Jun 22 20:25:35.207087 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1346/2609] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:35 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:36.232512 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:36.233499 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:36.240891 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:36.241337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:36.242124 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:36.242548 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:36.382787 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:36.394441 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0a6d0d74-a65f-4771-933b-e39a41c3a2b2 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.168276 Jun 22 20:25:36.395210 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1264/2610] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:36 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:37.415104 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:37.415973 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:37.418964 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:37.426467 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:37.426912 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:37.427667 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:37.428113 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:37.565897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:37.574062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6e637a3f-e7e8-4c97-8438-fea6056c490e tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.165672 Jun 22 20:25:37.574636 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1347/2611] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:37 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:38.597378 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:38.597966 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:38.600385 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=4 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:38.606701 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:38.607148 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:38.607915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:38.608381 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:38.749676 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:38.757498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-14eaaed2-eb36-47f9-a76d-63eb5b37b2dd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.166592 Jun 22 20:25:38.758069 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1265/2612] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:38 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:39.778705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:39.779714 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:39.783413 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=10 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:25:39.792717 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:39.793452 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:39.794767 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:39.795492 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:39.938898 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:39.946791 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-37e95243-266f-4b4f-8362-cfa5c0ec3322 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.174814 Jun 22 20:25:39.947362 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1348/2613] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:39 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:40.968204 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:40.969290 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:40.977272 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:40.977710 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:40.978459 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:40.978905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:41.117354 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:41.128885 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fc582b8c-0b29-4921-ae50-cfab34918394 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.166760 Jun 22 20:25:41.129673 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1266/2614] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:40 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:42.150988 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:42.151837 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:42.163019 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:42.163778 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:42.165098 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:42.165875 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:42.370174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:42.380269 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-21823ec3-c930-4ed3-b36c-8a52f31d139d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.235982 Jun 22 20:25:42.380848 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1349/2615] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:42 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:43.399000 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:43.399582 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:43.406465 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:43.406915 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:43.407675 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:43.408201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:43.594353 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:43.602016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a2bcfd68-4ef9-4fb9-8fa1-db2c2b46b54a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.207223 Jun 22 20:25:43.602584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1267/2616] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:43 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:44.622812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:44.623795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:44.632862 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:44.633348 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:44.634120 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:44.634547 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:44.770074 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:44.777511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-4e028cf6-806a-40a2-929b-a5c2d917818a req-9be0a70a-5913-4c5c-8f31-60d767d29287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debf9904-1e3f-454f-9f15-7b54a5f22ed0", "name": "network-vif-plugged", "status": "completed", "tag": "c7dcd8c1-5226-4a25-97ef-d1fd62cc4854"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:25:44.778026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-356ab351-e607-4ab1-aa13-6d6302d249bb tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.161723 Jun 22 20:25:44.778675 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1350/2617] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:44 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:44.791184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-4e028cf6-806a-40a2-929b-a5c2d917818a req-9be0a70a-5913-4c5c-8f31-60d767d29287 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:44.791628 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-4e028cf6-806a-40a2-929b-a5c2d917818a req-9be0a70a-5913-4c5c-8f31-60d767d29287 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:44.802540 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-4e028cf6-806a-40a2-929b-a5c2d917818a req-9be0a70a-5913-4c5c-8f31-60d767d29287 service nova] Creating event network-vif-plugged:c7dcd8c1-5226-4a25-97ef-d1fd62cc4854 for instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 on hv-cinder-84721 Jun 22 20:25:44.807801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-4e028cf6-806a-40a2-929b-a5c2d917818a req-9be0a70a-5913-4c5c-8f31-60d767d29287 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Jun 22 20:25:44.809405 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1268/2618] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:25:45.799363 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:45.800248 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:45.808522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:45.809017 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:45.809860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:45.810340 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:45.949000 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:45.958757 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c3ea43b0-c362-48a7-bc56-0aa429cc7f08 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1265 microversion: 2.1 time: 0.165961 Jun 22 20:25:45.959368 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1351/2619] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:45 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:46.981952 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:46.983104 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:46.994109 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:46.994860 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:46.996159 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:46.996893 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:47.132837 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:47.140607 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9ea27f77-c18c-48e9-9161-50d783672cf0 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1452 microversion: 2.1 time: 0.166534 Jun 22 20:25:47.141179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1269/2620] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:46 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:47.156739 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:25:47.157350 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:25:47.164431 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:47.164883 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:47.165643 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:47.166084 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:47.299175 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:25:47.307409 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-6cb4c988-4132-42f9-8bbe-858021b6696a tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1452 microversion: 2.1 time: 0.154543 Jun 22 20:25:47.307978 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1352/2621] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:25:47 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:25:48.690197 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:25:48.690996 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:25:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:25:48.943398 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-ad31a04b-be51-4238-a5b1-80ba4d3234c2 req-701bdad1-ec46-4174-b1dd-5dfc8a57736a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debf9904-1e3f-454f-9f15-7b54a5f22ed0", "tag": "c7dcd8c1-5226-4a25-97ef-d1fd62cc4854"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:25:48.951939 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ad31a04b-be51-4238-a5b1-80ba4d3234c2 req-701bdad1-ec46-4174-b1dd-5dfc8a57736a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:25:48.952409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-ad31a04b-be51-4238-a5b1-80ba4d3234c2 req-701bdad1-ec46-4174-b1dd-5dfc8a57736a service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:25:48.964250 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-ad31a04b-be51-4238-a5b1-80ba4d3234c2 req-701bdad1-ec46-4174-b1dd-5dfc8a57736a service nova] Creating event network-changed:c7dcd8c1-5226-4a25-97ef-d1fd62cc4854 for instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 on hv-cinder-84721 Jun 22 20:25:48.969393 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-ad31a04b-be51-4238-a5b1-80ba4d3234c2 req-701bdad1-ec46-4174-b1dd-5dfc8a57736a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029744 Jun 22 20:25:48.970008 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1270/2622] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:27:06.878500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:27:06.878500 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:27:48.902335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:27:48.903130 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=76 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:27:48.908367 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-153911634", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241802469", "security_groups": [{"name": "tempest-secgroup-smoke-639828283"}], "block_device_mapping_v2": [{"uuid": "ddd4a1d0-3802-46ae-9e80-4e42404a5950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d685ce8-70a7-436c-a39c-5459d163cb0e"}]}} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:27:49.026836 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.network.neutron [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] validate_networks() for [('3d685ce8-70a7-436c-a39c-5459d163cb0e', None, None, None, None, None)] {{(pid=124857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 20:27:49.418410 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 20:27:49.418827 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image limits 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 20:27:49.419299 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Flavor pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 20:27:49.419705 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Image pref 0:0:0 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 20:27:49.420136 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.virt.hardware [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 20:27:49.429086 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:49.429529 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:49.430323 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:49.430762 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:49.447833 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 20:27:49.452062 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.quota [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Getting quotas for user 6cd234ffa7214a23b14873c415dda768 and project 4939f5c261f4408fafc414bf7bdb6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=124857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 20:27:49.516326 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Going to run 1 instances... {{(pid=124857) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 20:27:49.518358 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddd4a1d0-3802-46ae-9e80-4e42404a5950',volume_size=None,volume_type=None)] {{(pid=124857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 20:27:49.660025 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d09607bf-c7e1-4997-a87a-129399171b59 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759756 Jun 22 20:27:49.660679 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1353/2623] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jun 22 20:27:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 20:27:49.670415 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 20:27:49.671064 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:27:49.672179 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:27:49.678643 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-fe6486c5-a5e5-41ec-b892-37ab26bff3a6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:49.679345 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-fe6486c5-a5e5-41ec-b892-37ab26bff3a6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:49.741577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-fe6486c5-a5e5-41ec-b892-37ab26bff3a6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:49.749079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-fe6486c5-a5e5-41ec-b892-37ab26bff3a6 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1093 microversion: 2.1 time: 0.082154 Jun 22 20:27:49.749692 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1271/2624] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:49 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:50.766811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:50.767388 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:50.774541 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:50.774986 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:50.775755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:50.776319 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:50.853811 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:50.861491 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-d7d5db23-df1b-4cd6-a4d3-b74c6255d116 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1209 microversion: 2.1 time: 0.099515 Jun 22 20:27:50.862059 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1354/2625] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:50 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:51.877852 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:51.878453 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:51.892544 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40900. Jun 22 20:27:51.894529 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:51.894961 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:51.895745 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:51.896177 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:52.035281 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:52.044021 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d515c154-3bfe-49c7-bc7f-2880143e98e1 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.169982 Jun 22 20:27:52.044657 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1272/2626] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:51 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:52.141544 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-94f47878-b09a-4feb-bdc6-ab654a8fc3ff req-21cb989d-46ea-4bbc-9f3b-ba8d6e51fdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80895506-8cf4-4fd5-8450-ea582ca964d9", "tag": "352ee883-9fb1-449f-b87a-0498d0d7dc32"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:27:52.151812 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-94f47878-b09a-4feb-bdc6-ab654a8fc3ff req-21cb989d-46ea-4bbc-9f3b-ba8d6e51fdda service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:52.152425 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-94f47878-b09a-4feb-bdc6-ab654a8fc3ff req-21cb989d-46ea-4bbc-9f3b-ba8d6e51fdda service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:52.167399 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-94f47878-b09a-4feb-bdc6-ab654a8fc3ff req-21cb989d-46ea-4bbc-9f3b-ba8d6e51fdda service nova] Creating event network-changed:352ee883-9fb1-449f-b87a-0498d0d7dc32 for instance 80895506-8cf4-4fd5-8450-ea582ca964d9 on hv-cinder-84721 Jun 22 20:27:52.174593 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-94f47878-b09a-4feb-bdc6-ab654a8fc3ff req-21cb989d-46ea-4bbc-9f3b-ba8d6e51fdda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039651 Jun 22 20:27:52.175322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1355/2627] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:27:53.065492 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:53.066507 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:53.077514 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:53.078253 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:53.079498 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:53.080261 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:53.214928 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:53.222479 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d9bb8164-ef81-4ffd-a793-c14f5c8b1864 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.163848 Jun 22 20:27:53.223019 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1273/2628] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:53 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:54.243930 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:54.245155 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:54.256374 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:54.257127 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:54.258522 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:54.259546 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:54.393213 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:54.402333 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-5a12bc7a-b882-4189-9532-71ede664e024 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.165233 Jun 22 20:27:54.403194 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1356/2629] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:54 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:55.429222 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:55.430153 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:55.438014 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:55.438464 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:55.439226 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:55.439653 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:55.575739 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:55.587051 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9422dee1-0e32-4c3b-a244-e205faff34d9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.163995 Jun 22 20:27:55.587680 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1274/2630] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:55 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:56.605312 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:56.606040 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:56.614109 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:56.614638 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:56.615533 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:56.616043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:56.753232 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:56.760953 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-81f8a765-cad8-4924-b180-c1d8b26ddc77 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.160321 Jun 22 20:27:56.761499 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1357/2631] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:56 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:57.781767 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:57.782598 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:57.793567 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:57.794351 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:57.795584 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:57.796340 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:57.946646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:57.954337 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-9bfeec3e-d5ef-4fdd-8f56-c255b0f3c05b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.179474 Jun 22 20:27:57.954907 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1275/2632] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:57 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:27:58.973960 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:27:58.974807 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:27:58.984453 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:58.985083 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:58.986150 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:27:58.986754 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:27:59.127661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:27:59.135481 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-c769a50a-4031-4b30-9312-c8b3a7888843 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.166996 Jun 22 20:27:59.135959 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1358/2633] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:27:58 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:00.156247 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:00.157241 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:00.160926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell0:SELECT=2 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:28:00.169392 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:00.169827 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:00.170577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:00.171002 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:00.307373 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:00.318417 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-609db38f-8de9-4cd5-b5a6-070ef5ece4f5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.168418 Jun 22 20:28:00.319211 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1276/2634] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:00 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:01.338414 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:01.339396 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:01.341756 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=2 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:28:01.342456 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell0:SELECT=6 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:28:01.348961 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:01.349406 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:01.350205 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:01.350629 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:01.486724 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:01.494354 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-934aa5df-0819-48f4-9a74-e1878205a2fa tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.159868 Jun 22 20:28:01.494939 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1359/2635] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:01 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:02.511034 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:02.511646 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:02.518848 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:02.519295 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:02.520056 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:02.520478 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:02.661127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:02.673243 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-71103d62-4b53-4c85-a432-07e0f7831a8c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.165800 Jun 22 20:28:02.674035 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1277/2636] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:02 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:03.548614 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-81ed7e5d-92b3-4873-bfa8-a66f99cfa77c req-ac36a4ca-5860-465a-95b6-ca6b7ff73aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80895506-8cf4-4fd5-8450-ea582ca964d9", "name": "network-vif-plugged", "status": "completed", "tag": "352ee883-9fb1-449f-b87a-0498d0d7dc32"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:28:03.557462 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-81ed7e5d-92b3-4873-bfa8-a66f99cfa77c req-ac36a4ca-5860-465a-95b6-ca6b7ff73aca service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:03.558035 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-81ed7e5d-92b3-4873-bfa8-a66f99cfa77c req-ac36a4ca-5860-465a-95b6-ca6b7ff73aca service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:03.570065 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-81ed7e5d-92b3-4873-bfa8-a66f99cfa77c req-ac36a4ca-5860-465a-95b6-ca6b7ff73aca service nova] Creating event network-vif-plugged:352ee883-9fb1-449f-b87a-0498d0d7dc32 for instance 80895506-8cf4-4fd5-8450-ea582ca964d9 on hv-cinder-84721 Jun 22 20:28:03.575026 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-81ed7e5d-92b3-4873-bfa8-a66f99cfa77c req-ac36a4ca-5860-465a-95b6-ca6b7ff73aca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095500 Jun 22 20:28:03.575672 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1360/2637] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:28:03.695477 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:03.696807 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:03.704302 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:03.704751 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:03.705576 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:03.706144 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:03.855016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:03.862906 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-d023e443-8b06-4905-a6dc-e7b06b9fa22b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.171582 Jun 22 20:28:03.863494 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1278/2638] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:03 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:04.887160 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:04.888142 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:04.895740 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:04.896186 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:04.896976 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:04.897402 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:05.028948 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:05.037089 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-121a55eb-e018-40b9-88ea-cf8a224b0e42 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1264 microversion: 2.1 time: 0.159514 Jun 22 20:28:05.037661 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1361/2639] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:04 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:06.055875 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:06.056615 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:06.065017 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:06.065577 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:06.066523 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:06.067062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:06.207205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:06.218016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-5a674f3f-867e-4a39-af82-cd9000284e04 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1452 microversion: 2.1 time: 0.167218 Jun 22 20:28:06.218592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1279/2640] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:06 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:06.235945 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:28:06.236603 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:28:06.243174 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:06.243623 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:06.244416 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:06.244845 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:06.392924 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:28:06.404787 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-0f2b9002-adf9-42ee-ba12-a922882bce1d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1452 microversion: 2.1 time: 0.173353 Jun 22 20:28:06.405364 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1362/2641] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:28:06 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:28:08.431877 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-aedea71e-5a63-42b1-a432-1fea69e1166d req-b084d959-1b72-429c-bfe0-cf68752e11c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80895506-8cf4-4fd5-8450-ea582ca964d9", "tag": "352ee883-9fb1-449f-b87a-0498d0d7dc32"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:28:08.439955 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-aedea71e-5a63-42b1-a432-1fea69e1166d req-b084d959-1b72-429c-bfe0-cf68752e11c2 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:28:08.440430 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-aedea71e-5a63-42b1-a432-1fea69e1166d req-b084d959-1b72-429c-bfe0-cf68752e11c2 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:28:08.451127 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-aedea71e-5a63-42b1-a432-1fea69e1166d req-b084d959-1b72-429c-bfe0-cf68752e11c2 service nova] Creating event network-changed:352ee883-9fb1-449f-b87a-0498d0d7dc32 for instance 80895506-8cf4-4fd5-8450-ea582ca964d9 on hv-cinder-84721 Jun 22 20:28:08.456433 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-aedea71e-5a63-42b1-a432-1fea69e1166d req-b084d959-1b72-429c-bfe0-cf68752e11c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080772 Jun 22 20:28:08.457044 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1280/2642] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:28:44.481507 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:28:44.482070 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:28:54.840614 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:28:54.841434 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:28:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:29:58.115958 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:29:58.117046 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG dbcounter [-] [124857] Writing DB stats nova_cell1:SELECT=48 {{(pid=124857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:29:58.120574 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 20:29:58.121014 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:29:58.121225 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_api:SELECT=22 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:29:58.121327 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:29:58.121956 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG dbcounter [-] [124856] Writing DB stats nova_cell1:SELECT=50 {{(pid=124856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 20:29:58.126812 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-110c7358-765f-4865-b5e0-4847b3ff5b55 req-06b33165-a1b0-4adc-96e4-4fb6a28e08b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80895506-8cf4-4fd5-8450-ea582ca964d9", "tag": "352ee883-9fb1-449f-b87a-0498d0d7dc32"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:29:58.128712 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:58.129394 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:58.130189 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:58.130594 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:58.138170 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-110c7358-765f-4865-b5e0-4847b3ff5b55 req-06b33165-a1b0-4adc-96e4-4fb6a28e08b7 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:58.138616 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-110c7358-765f-4865-b5e0-4847b3ff5b55 req-06b33165-a1b0-4adc-96e4-4fb6a28e08b7 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:58.150156 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-110c7358-765f-4865-b5e0-4847b3ff5b55 req-06b33165-a1b0-4adc-96e4-4fb6a28e08b7 service nova] Creating event network-changed:352ee883-9fb1-449f-b87a-0498d0d7dc32 for instance 80895506-8cf4-4fd5-8450-ea582ca964d9 on hv-cinder-84721 Jun 22 20:29:58.156318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-110c7358-765f-4865-b5e0-4847b3ff5b55 req-06b33165-a1b0-4adc-96e4-4fb6a28e08b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Jun 22 20:29:58.156318 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1281/2643] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:29:58.156574 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:29:58.247055 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-04068eb8-3840-4341-b020-91118547c00c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 204 len: 0 microversion: 2.1 time: 0.132671 Jun 22 20:29:58.247686 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1363/2644] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:29:58 2022] DELETE /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:29:58.257041 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:29:58.258905 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:29:58.265320 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:58.265763 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:58.266534 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:58.266967 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:58.406350 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:29:58.414390 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-1f762ed0-2630-497b-afc4-ef42200384a3 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1576 microversion: 2.1 time: 0.161866 Jun 22 20:29:58.414931 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1282/2645] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:29:58 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:29:59.432771 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:29:59.433470 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:29:59.440466 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:59.440897 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:59.441660 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:29:59.442097 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:29:59.599919 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:29:59.611110 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-be823ef9-5028-4fa8-99d0-2ac2b2381ca8 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1576 microversion: 2.1 time: 0.182466 Jun 22 20:29:59.611820 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1364/2646] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:29:59 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:30:00.628949 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:00.629524 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:00.643322 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] [bcc0a890-3507-4832-bb93-260e020a1bc8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40994. Jun 22 20:30:00.645667 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:00.646107 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:00.646869 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:00.647289 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:00.719371 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:30:00.727307 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-a7e3fdb9-c796-4d56-87b0-6eb59d2b0a6d tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 200 len: 1391 microversion: 2.1 time: 0.102325 Jun 22 20:30:00.727855 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1283/2647] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:00 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 1391 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:30:00.754783 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [req-baa7e757-a959-4137-9395-c7cccf4a5c63 req-927701c5-b31f-418c-a782-b0540fcca806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80895506-8cf4-4fd5-8450-ea582ca964d9", "name": "network-vif-deleted", "tag": "352ee883-9fb1-449f-b87a-0498d0d7dc32"}]} {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:30:00.763417 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-baa7e757-a959-4137-9395-c7cccf4a5c63 req-927701c5-b31f-418c-a782-b0540fcca806 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:00.763860 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [req-baa7e757-a959-4137-9395-c7cccf4a5c63 req-927701c5-b31f-418c-a782-b0540fcca806 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:00.777539 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.compute.server_external_events [req-baa7e757-a959-4137-9395-c7cccf4a5c63 req-927701c5-b31f-418c-a782-b0540fcca806 service nova] Creating event network-vif-deleted:352ee883-9fb1-449f-b87a-0498d0d7dc32 for instance 80895506-8cf4-4fd5-8450-ea582ca964d9 on hv-cinder-84721 Jun 22 20:30:00.782680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [req-baa7e757-a959-4137-9395-c7cccf4a5c63 req-927701c5-b31f-418c-a782-b0540fcca806 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031586 Jun 22 20:30:00.783262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1365/2648] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 20:30:01.744592 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:01.745184 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 80895506-8cf4-4fd5-8450-ea582ca964d9] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:01.751865 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:01.752346 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:01.753094 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:01.753517 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:01.767361 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] HTTP exception thrown: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Request method failure captured: Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 HTTP/1.1 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3n6YVPyOHZ2B5YdjTZiKMZ2MpX6K1n21b9YAz5NQpdBAn3UDQYlAH7H68xYVauMj8PMGKaeorZ6xdBXOmFPoVcdGd1jRlRBpQDO_6aVYVqA2YoVixOtN1qJbl5QYzhAJXQMjCYvq8T4CF6VxTW8cyvFtwujElV-AA5TdPLXEgTdprA Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:30:01.769020 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4939f5c261f4408fafc414bf7bdb6f09", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 6cd234ffa7214a23b14873c415dda768 Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. Jun 22 20:30:01.770485 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '80895506-8cf4-4fd5-8450-ea582ca964d9'} Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:30:01.771205 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. Jun 22 20:30:01.772316 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:01.773238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Returning 404 to user: Instance 80895506-8cf4-4fd5-8450-ea582ca964d9 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:30:01.773238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-7d9e3ad5-bf7f-4efa-8866-9ba5ac2935b9 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9" status: 404 len: 111 microversion: 2.1 time: 0.029906 Jun 22 20:30:01.773238 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1284/2649] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:01 2022] GET /compute/v2.1/servers/80895506-8cf4-4fd5-8450-ea582ca964d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:30:04.914322 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:04.915124 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:04.915987 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-771093e6-071b-4fcf-b0bd-5690ca3580b0 req-6ddc1152-1215-4ca6-9e1f-df058e4c32a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debf9904-1e3f-454f-9f15-7b54a5f22ed0", "tag": "c7dcd8c1-5226-4a25-97ef-d1fd62cc4854"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:30:04.921984 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:04.922515 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:04.923375 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:04.923888 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:04.924801 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-771093e6-071b-4fcf-b0bd-5690ca3580b0 req-6ddc1152-1215-4ca6-9e1f-df058e4c32a3 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:04.925449 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-771093e6-071b-4fcf-b0bd-5690ca3580b0 req-6ddc1152-1215-4ca6-9e1f-df058e4c32a3 service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:04.936981 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-771093e6-071b-4fcf-b0bd-5690ca3580b0 req-6ddc1152-1215-4ca6-9e1f-df058e4c32a3 service nova] Creating event network-changed:c7dcd8c1-5226-4a25-97ef-d1fd62cc4854 for instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 on hv-cinder-84721 Jun 22 20:30:04.942409 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-771093e6-071b-4fcf-b0bd-5690ca3580b0 req-6ddc1152-1215-4ca6-9e1f-df058e4c32a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031045 Jun 22 20:30:04.943160 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1285/2650] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:30:04.951288 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Going to try to terminate instance {{(pid=124857) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 20:30:05.040125 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-bb855761-e769-4ec5-96bf-7b6aa1d3298b tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "DELETE /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 204 len: 0 microversion: 2.1 time: 0.130552 Jun 22 20:30:05.041013 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1366/2651] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:30:04 2022] DELETE /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 20:30:05.051349 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:05.052039 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:05.059737 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:05.060436 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:05.061404 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:05.062001 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:05.197141 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.policy [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124856) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:30:05.205016 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-04adef37-efab-43a0-bad2-e667eb2db3e5 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1576 microversion: 2.1 time: 0.159140 Jun 22 20:30:05.205586 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1286/2652] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:05 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:30:06.223668 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:06.224407 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:06.231262 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:06.231703 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:06.232498 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:06.232914 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:06.419003 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:30:06.427043 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-11e2c24e-8676-404a-a6ec-217dc55d1915 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1576 microversion: 2.1 time: 0.207672 Jun 22 20:30:06.427616 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1367/2653] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:06 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:30:07.293344 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [req-8bfe7804-0195-4338-8f43-1c6cdacb9c42 req-1310f5a4-eca6-41f1-81c0-cf6e11c942fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debf9904-1e3f-454f-9f15-7b54a5f22ed0", "name": "network-vif-deleted", "tag": "c7dcd8c1-5226-4a25-97ef-d1fd62cc4854"}]} {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 20:30:07.302571 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-8bfe7804-0195-4338-8f43-1c6cdacb9c42 req-1310f5a4-eca6-41f1-81c0-cf6e11c942fb service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:07.303013 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [req-8bfe7804-0195-4338-8f43-1c6cdacb9c42 req-1310f5a4-eca6-41f1-81c0-cf6e11c942fb service nova] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:07.314386 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.compute.server_external_events [req-8bfe7804-0195-4338-8f43-1c6cdacb9c42 req-1310f5a4-eca6-41f1-81c0-cf6e11c942fb service nova] Creating event network-vif-deleted:c7dcd8c1-5226-4a25-97ef-d1fd62cc4854 for instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 on hv-cinder-84721 Jun 22 20:30:07.319240 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [req-8bfe7804-0195-4338-8f43-1c6cdacb9c42 req-1310f5a4-eca6-41f1-81c0-cf6e11c942fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Jun 22 20:30:07.319822 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1287/2654] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jun 22 20:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 20:30:07.445708 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:07.446335 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:07.453526 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:07.453966 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:07.454741 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:07.455178 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:07.517688 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.policy [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd234ffa7214a23b14873c415dda768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4939f5c261f4408fafc414bf7bdb6f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124857) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 20:30:07.525637 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-43f13543-4d00-4190-bfc2-2d4c94714ebd tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 200 len: 1225 microversion: 2.1 time: 0.086000 Jun 22 20:30:07.526320 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1368/2655] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:07 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 20:30:08.549173 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:08.550431 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: debf9904-1e3f-454f-9f15-7b54a5f22ed0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:08.561239 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:08.561977 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:08.563223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:08.563940 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:08.583602 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] HTTP exception thrown: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Request method failure captured: Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 HTTP/1.1 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3n6YVPyOHZ2B5YdjTZiKMZ2MpX6K1n21b9YAz5NQpdBAn3UDQYlAH7H68xYVauMj8PMGKaeorZ6xdBXOmFPoVcdGd1jRlRBpQDO_6aVYVqA2YoVixOtN1qJbl5QYzhAJXQMjCYvq8T4CF6VxTW8cyvFtwujElV-AA5TdPLXEgTdprA Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:30:08.585215 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4939f5c261f4408fafc414bf7bdb6f09", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 6cd234ffa7214a23b14873c415dda768 Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. Jun 22 20:30:08.586511 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': 'debf9904-1e3f-454f-9f15-7b54a5f22ed0'} Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:30:08.587265 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. Jun 22 20:30:08.588541 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:08.589634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Returning 404 to user: Instance debf9904-1e3f-454f-9f15-7b54a5f22ed0 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:30:08.589634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-14404b73-62a5-41fa-92d2-914882c4ac20 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0" status: 404 len: 111 microversion: 2.1 time: 0.045797 Jun 22 20:30:08.589634 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1288/2656] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:08 2022] GET /compute/v2.1/servers/debf9904-1e3f-454f-9f15-7b54a5f22ed0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:30:09.051505 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:09.052050 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.compute.api [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124857) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:09.059114 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:09.059680 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:09.060469 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:09.060899 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG oslo_concurrency.lockutils [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:09.074273 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.wsgi [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] HTTP exception thrown: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Request method failure captured: Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: request: DELETE /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 HTTP/1.1 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept: application/json Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Accept-Encoding: identity Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Connection: close Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Length: 0 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Content-Type: application/json Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Host: 10.222.0.26 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Openstack-System-Scope: None Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: User-Agent: python-urllib3/1.26.9 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Auth-Token: gAAAAABis3n6YVPyOHZ2B5YdjTZiKMZ2MpX6K1n21b9YAz5NQpdBAn3UDQYlAH7H68xYVauMj8PMGKaeorZ6xdBXOmFPoVcdGd1jRlRBpQDO_6aVYVqA2YoVixOtN1qJbl5QYzhAJXQMjCYvq8T4CF6VxTW8cyvFtwujElV-AA5TdPLXEgTdprA Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Id: None Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Domain-Name: None Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Identity-Status: Confirmed Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Is-Admin-Project: True Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Id: default Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Domain-Name: Default Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Project-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Role: reader,member Jun 22 20:30:09.076006 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Roles: reader,member Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4939f5c261f4408fafc414bf7bdb6f09", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Id: default Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Domain-Name: Default Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Id: 6cd234ffa7214a23b14873c415dda768 Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: X-User-Name: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: method: > Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: exception: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.077377 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: action_args: {'id': '082c0f64-fab7-4c59-9372-8891697212d0'} Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:30:09.078117 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.079318 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.080691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Returning 404 to user: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. {{(pid=124857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:30:09.080691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-2c75b0e9-98fa-4bc3-ade1-5c0baa55a84c tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "DELETE /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jun 22 20:30:09.080691 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1369/2657] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jun 22 20:30:09 2022] DELETE /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:30:09.086079 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '>' {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:09.086690 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.compute.api [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] [instance: 082c0f64-fab7-4c59-9372-8891697212d0] Fetching instance by UUID {{(pid=124856) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 20:30:09.093564 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:09.094011 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:09.094797 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 20:30:09.095223 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG oslo_concurrency.lockutils [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Lock "4ffa8d7d-d486-428a-890e-0435466b218e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 20:30:09.108871 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.wsgi [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] HTTP exception thrown: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Request method failure captured: Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: request: GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 HTTP/1.1 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept: application/json Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Accept-Encoding: identity Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Connection: close Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Length: 0 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Content-Type: application/json Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Host: 10.222.0.26 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Openstack-System-Scope: None Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: User-Agent: python-urllib3/1.26.9 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Auth-Token: gAAAAABis3n6YVPyOHZ2B5YdjTZiKMZ2MpX6K1n21b9YAz5NQpdBAn3UDQYlAH7H68xYVauMj8PMGKaeorZ6xdBXOmFPoVcdGd1jRlRBpQDO_6aVYVqA2YoVixOtN1qJbl5QYzhAJXQMjCYvq8T4CF6VxTW8cyvFtwujElV-AA5TdPLXEgTdprA Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Id: None Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Domain-Name: None Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Identity-Status: Confirmed Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Is-Admin-Project: True Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Id: default Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Domain-Name: Default Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Project-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Role: reader,member Jun 22 20:30:09.110363 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Roles: reader,member Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4939f5c261f4408fafc414bf7bdb6f09", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4939f5c261f4408fafc414bf7bdb6f09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Id: 4939f5c261f4408fafc414bf7bdb6f09 Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600543485 Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Id: default Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Domain-Name: Default Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Id: 6cd234ffa7214a23b14873c415dda768 Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: X-User-Name: tempest-TestVolumeBootPattern-1600543485-project Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: method: > Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: exception: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.111627 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: action_args: {'id': '082c0f64-fab7-4c59-9372-8891697212d0'} Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: {{(pid=124856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 20:30:09.112328 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. Jun 22 20:30:09.113319 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: ERROR nova.api.openstack.wsgi Jun 22 20:30:09.114201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: DEBUG nova.api.openstack.wsgi [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Returning 404 to user: Instance 082c0f64-fab7-4c59-9372-8891697212d0 could not be found. {{(pid=124856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 20:30:09.114201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO nova.api.openstack.requestlog [None req-0a89dc14-d9bf-409e-b95c-5e3bce8117b4 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0" status: 404 len: 111 microversion: 2.1 time: 0.029667 Jun 22 20:30:09.114201 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: [pid: 124856|app: 0|req: 1289/2658] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jun 22 20:30:09 2022] GET /compute/v2.1/servers/082c0f64-fab7-4c59-9372-8891697212d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 20:30:10.423555 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: DEBUG nova.api.openstack.wsgi [None req-ad77b1f6-a73d-4720-bfab-3bc7deb99310 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] Calling method '.version_select at 0x7fdc19e028b0>' {{(pid=124857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 20:30:10.448923 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO nova.api.openstack.requestlog [None req-ad77b1f6-a73d-4720-bfab-3bc7deb99310 tempest-TestVolumeBootPattern-1600543485 tempest-TestVolumeBootPattern-1600543485-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241802469" status: 202 len: 0 microversion: 2.1 time: 0.029739 Jun 22 20:30:10.449612 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: [pid: 124857|app: 0|req: 1370/2659] 10.222.0.26 () {58 vars in 1259 bytes} [Wed Jun 22 20:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241802469 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 20:30:26.892062 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:30:26.893926 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:30:36.053779 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:30:36.054565 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:32:14.853983 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:32:14.855902 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:32:30.443677 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:32:30.444823 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:33:46.905071 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:33:46.906805 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:33:56.063795 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:33:56.064344 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:35:24.495135 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:35:24.495755 dv-cinder-847216-1-iscsi devstack@n-api.service[124857]: Wed Jun 22 20:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 20:35:34.867085 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 20:35:34.867606 dv-cinder-847216-1-iscsi devstack@n-api.service[124856]: Wed Jun 22 20:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!